[ 525.922063] env[65029]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.922063] env[65029]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.939763] env[65119]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.939763] env[65119]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 528.521497] env[65119]: INFO neutron.common.config [-] Logging enabled! [ 528.521765] env[65119]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 528.522073] env[65119]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65119) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 528.522376] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 528.522475] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 528.523319] env[65119]: WARNING oslo_policy.policy [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 528.523542] env[65119]: WARNING oslo_policy.policy [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 528.525235] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] VMware NSXv3 Agent initialized successfully. [ 528.525617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Acquiring lock "singleton_lock" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.525749] env[65119]: DEBUG oslo_concurrency.lockutils [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Acquired lock "singleton_lock" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.525951] env[65119]: DEBUG oslo_concurrency.lockutils [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Releasing lock "singleton_lock" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.526240] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Full set of CONF: {{(pid=65119) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 528.526404] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ******************************************************************************** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 528.526485] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Configuration options gathered from: {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 528.526836] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 528.527086] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 528.527143] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ================================================================================ {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 528.527286] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] agent_down_time = 75 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.527426] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] allow_automatic_dhcp_failover = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.527559] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] allow_bulk = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.527700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] api_extensions_path = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.527840] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] api_paste_config = api-paste.ini {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.527980] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] auth_strategy = keystone {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528095] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] backdoor_port = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528195] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] backdoor_socket = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528327] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] backlog = 4096 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528464] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528620] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] bind_host = 0.0.0.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528762] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] bind_port = 9696 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.528895] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] client_socket_timeout = 900 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529038] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] config_dir = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529149] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529282] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] config_source = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529419] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] control_exchange = neutron {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529559] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] core_plugin = ml2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529694] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] debug = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.529827] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] default_availability_zones = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530110] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530218] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dhcp_agent_notification = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530309] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dhcp_agents_per_network = 1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530444] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dhcp_lease_duration = 86400 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530587] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dhcp_load_type = networks {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530724] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dns_domain = openstacklocal {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530860] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.530992] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_default_route_bfd = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.531135] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_default_route_ecmp = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.531405] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_dvr = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.531651] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_new_agents = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.531879] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.532115] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_signals = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] enable_traditional_dhcp = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] external_dns_driver = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] filter_validation = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] global_physnet_mtu = 8950 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] graceful_shutdown_timeout = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533299] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] host = cpu-1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533541] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] host_dvr_for_dhcp = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.533781] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] http_retries = 3 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.534026] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] instance_format = [instance: %(uuid)s] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.534277] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.534516] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ipam_driver = internal {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.534756] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ipv6_pd_enabled = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535558] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] l3_ha = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535558] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535558] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] l3_ha_network_physical_name = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535558] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] l3_ha_network_type = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535737] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_color = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535737] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_config_append = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.535856] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.536122] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_dir = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.536387] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_file = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.536601] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_options = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.536843] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_rotate_interval = 1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.537100] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_rotate_interval_type = days {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.537352] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] log_rotation_type = none {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538321] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538321] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_dns_nameservers = 5 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538321] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_header_line = 16384 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538441] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_l3_agents_per_router = 3 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538574] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_logfile_count = 30 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.538818] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_logfile_size_mb = 200 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.539054] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] max_subnet_host_routes = 20 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.539303] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] my_ip = 10.180.1.21 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.539546] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] my_ipv6 = ::1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.539788] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] network_auto_schedule = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] network_link_prefix = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] notify_nova_on_port_data_changes = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] notify_nova_on_port_status_changes = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] pagination_max_limit = -1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541028] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] publish_errors = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541254] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rate_limit_burst = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541254] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rate_limit_except_level = CRITICAL {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541254] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rate_limit_interval = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541254] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] retry_until_window = 30 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541366] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] router_distributed = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541450] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rpc_resources_processing_step = 20 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541686] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rpc_response_max_timeout = 600 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.541959] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] rpc_response_timeout = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.542226] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] send_events_interval = 2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.542488] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] service_plugins = ['router'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.542736] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] setproctitle = on {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.542971] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] shell_completion = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.543233] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] state_path = /opt/stack/data/neutron {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.543478] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] syslog_log_facility = LOG_USER {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.543723] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] tcp_keepidle = 600 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.543971] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] transport_url = **** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.544216] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] use_journal = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] use_json = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] use_ssl = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] use_stderr = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] use_syslog = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vlan_qinq = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545402] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vlan_transparent = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545658] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] watch_log_file = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.545890] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] wsgi_default_pool_size = 100 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.546137] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] wsgi_keep_alive = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.547041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.547041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] wsgi_server_debug = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 528.547041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_concurrency.disable_process_locking = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547041] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547253] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547347] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547410] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547667] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.547926] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.connection_string = messaging:// {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.548205] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.enabled = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.548481] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.es_doc_type = notification {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.548732] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.es_scroll_size = 10000 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.548971] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.es_scroll_time = 2m {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.549234] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.filter_error_trace = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.549828] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.hmac_keys = **** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.549828] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.sentinel_service_name = mymaster {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.549828] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.socket_timeout = 0.1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.549984] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.trace_requests = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.550058] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler.trace_sqlalchemy = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.550316] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler_jaeger.process_tags = {} {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.550561] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler_jaeger.service_name_prefix = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552433] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] profiler_otlp.service_name_prefix = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552433] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.enforce_new_defaults = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552433] env[65119]: WARNING oslo_config.cfg [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 528.552433] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.enforce_scope = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552433] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.policy_default_rule = default {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552433] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552700] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552862] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552862] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.552961] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] agent.extensions = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.553246] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.553499] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] service_providers.service_provider = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.553742] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.default_quota = -1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.553991] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.554250] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_floatingip = 50 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.554497] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_network = 100 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.554742] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_port = 500 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.554973] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.555214] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_router = 10 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.555474] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_security_group = 10 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.555731] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.555978] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.quota_subnet = 100 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.556233] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] QUOTAS.track_quota_usage = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.556584] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.556954] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558030] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558250] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558250] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558377] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558633] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.558877] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.559119] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_dhcp_release.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.559555] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.559640] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.560116] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.560116] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.560116] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.560226] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.560360] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_ovs_vsctl.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.capabilities = [21] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563017] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_namespace.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.capabilities = [12] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_conntrack.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563539] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.capabilities = [12, 21] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563539] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.group = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563539] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.helper_command = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.563539] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.log_daemon_traceback = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.thread_pool_size = 8 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] privsep_link.user = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565024] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.continue_on_failed_promotions = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565256] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.dscp = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565256] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.dscp_inherit = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565256] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.force_mp_to_policy = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565256] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.locking_coordinator_url = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565420] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.log_agent_heartbeats = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565520] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.logging_expire = 1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565663] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565806] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.565951] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.polling_interval = 240 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566102] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566247] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566399] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.report_interval = 30.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566547] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566688] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566829] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.566965] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.sync_skew = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.567122] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.synchronization_queue_size = 20 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.567394] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT.use_helper_for_ns_read = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.567640] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] SECURITYGROUP.enable_ipset = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.567890] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] SECURITYGROUP.enable_security_group = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.568157] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.568415] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.568675] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] experimental.ipv6_pd_enabled = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.568942] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.extension_drivers = ['port_security'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.569196] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.external_network_type = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.569459] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.569707] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.overlay_ip_version = 4 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.569955] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.path_mtu = 8950 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.physical_network_mtus = {} {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ml2.type_drivers = ['vlan'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571048] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571282] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571359] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571631] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.571887] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.572158] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.572419] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.572663] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.572966] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_login_password = **** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_login_user = admin {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574022] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574234] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574269] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574391] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574652] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.574896] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.575154] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.575412] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.575674] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.575921] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.576182] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.576543] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.576806] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.auth_section = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.auth_type = password {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579014] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.certfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.collect_timing = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.endpoint_type = public {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.insecure = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.keyfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.region_name = RegionOne {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.split_loggers = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579260] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] nova.timeout = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579481] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.auth_section = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579481] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.auth_type = password {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579708] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.579952] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.certfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.580211] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.collect_timing = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.580471] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.endpoint_type = public {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.580720] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.insecure = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.580956] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.keyfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.581316] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.region_name = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.581568] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.split_loggers = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.581873] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] placement.timeout = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.582128] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.auth_section = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.582376] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.auth_type = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.582609] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.cafile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.582849] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.certfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.583099] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.collect_timing = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.583328] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.connect_retries = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.583575] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.connect_retry_delay = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.583816] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.enable_notifications = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.584069] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.endpoint_override = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.insecure = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.interface = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.keyfile = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.max_version = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.min_version = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585047] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.region_name = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585354] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.retriable_status_codes = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585354] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.service_name = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585414] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.service_type = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585530] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.split_loggers = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.585793] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.status_code_retries = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.586046] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.status_code_retry_delay = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.586308] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.timeout = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.586653] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.valid_interfaces = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.587031] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ironic.version = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.587422] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] cli_script.dry_run = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590076] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590508] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590508] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590508] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590586] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590677] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.590922] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.591184] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.591538] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.591808] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.592061] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.592312] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.592575] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.592823] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.593089] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.593348] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.593588] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.593829] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.594085] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.594320] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.594573] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.594818] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.595070] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.595327] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.595599] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.595850] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.596115] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_notifications.driver = [] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.596389] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_notifications.retry = -1 {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.596669] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.596916] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 528.597131] env[65119]: DEBUG oslo_service.backend._eventlet.service [None req-aec0b137-26ba-4101-8c46-179670994c51 None None] ******************************************************************************** {{(pid=65119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 528.598393] env[65119]: DEBUG neutron.agent.securitygroups_rpc [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Init firewall settings (driver=nsxv3) {{(pid=65119) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 528.599827] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65119) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 528.600196] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] RPC agent_id: nsxm-l-01a.corp.local [ 528.602843] env[65119]: DEBUG dogpile.cache.region [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 528.602935] env[65119]: DEBUG dogpile.lock [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 528.603031] env[65119]: DEBUG dogpile.lock [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 528.604025] env[65119]: DEBUG dogpile.lock [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 528.604025] env[65119]: DEBUG dogpile.cache.region [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 528.604025] env[65119]: DEBUG dogpile.lock [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 528.604025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 528.624683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Session token - acquiring [ 528.626941] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.627369] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.627594] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.628136] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.639870] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.922775] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 528.944572] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 528.945625] env[65119]: DEBUG dogpile.cache.region [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Cache value generated in 0.342 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 528.945625] env[65119]: DEBUG dogpile.lock [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 528.945625] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Activating Policy API Provider. [ 528.945625] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Looking for the default Infrastructure Rules. [ 529.012204] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Looking for the Default Layer3 Logged Drop Section. [ 529.029395] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 529.030733] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.030733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.030733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.030733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.031078] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.547763] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.051853] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.554478] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Inventory metadata is going to be refreshed. [ 530.554478] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 531.295019] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.295019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.295019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.295019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.306930] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 531.308090] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.308795] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 531.326815] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.329019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.329019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.329019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.329019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.329019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 531.329019] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 531.329019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 531.346778] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.347312] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.347568] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.349071] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.349071] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.349071] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 531.371039] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.371039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.371039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.371039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.371039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.371039] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 531.389384] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.389836] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.390077] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.390459] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.390748] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.391025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 531.391269] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 531.391521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 531.411433] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.411433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.411433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.411433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.411433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.411433] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 531.411433] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 531.411433] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 531.432021] env[65119]: DEBUG networking_nsxv3.common.locking [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.432021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.432021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.432021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.432021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.432021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 531.432021] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 531.432021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Inventory metadata have been refreshed. [ 531.432021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Dryrun:True. Metadata refresh completed. [ 531.432021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.432884] env[65119]: INFO neutron.agent.agent_extensions_manager [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Loaded agent extensions: [] [ 531.433752] env[65119]: DEBUG neutron_lib.callbacks.manager [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65119) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 531.482765] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent RPC Daemon Started! [ 531.483467] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:0 started [ 531.483467] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent out of sync with plugin! [ 536.434860] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 536.434860] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.436060] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.436534] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.437845] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.438221] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.751555] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6b503a7d-7952-482f-847f-366c14e9cc6f demo admin] Enqueued Resource ID: 7a7ef7a5-9d5f-4340-88a5-12c75808b532 with Priority: HIGHEST for action security_group_rules [ 546.752088] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ef7a5-9d5f-4340-88a5-12c75808b532 with Priority: HIGHEST for action security_group_rules [ 546.752402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ef7a5-9d5f-4340-88a5-12c75808b532 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.752592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ef7a5-9d5f-4340-88a5-12c75808b532" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.752592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ef7a5-9d5f-4340-88a5-12c75808b532" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.752941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ef7a5-9d5f-4340-88a5-12c75808b532" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.753072] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ef7a5-9d5f-4340-88a5-12c75808b532',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.272811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.273075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.273075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.273278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.273381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.273540] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ef7a5-9d5f-4340-88a5-12c75808b532 already deleted. [ 547.273540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ef7a5-9d5f-4340-88a5-12c75808b532" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.753542] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.754281] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.437344] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.437727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.437727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.437836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.437976] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.940135] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.442856] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.945544] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 554.945773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 555.674768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.675204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.675204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.675204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.686073] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 555.686907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.687709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 555.704532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.704705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.704751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.704971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.705076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.705182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 555.705253] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.705324] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 555.724263] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.724439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.724480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.724681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.724815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.724946] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 555.744185] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.744370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.744370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.744562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.744661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.744765] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 555.762437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.762598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.762644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.762808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.762905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.763028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 555.763107] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.763171] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 555.779767] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.779989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.779989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.780177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.780266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.780369] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 555.780439] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.780501] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 555.797819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.798016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.798016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.798210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.798310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.798418] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 555.798490] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.798554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 555.798619] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 555.798692] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 555.798756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 555.798810] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 555.799096] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 555.799158] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 555.799220] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 555.819018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.819228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.819228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.819455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.819559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.819668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 555.843180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.843397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.843397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.843598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.843703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.856256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.755497] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.755750] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.756341] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.756731] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.757631] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.757631] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.759095] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.759446] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.706480] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a7aab5c2-adef-4cd6-a5fd-86b6b0881a8f None None] Enqueued Resource ID: 650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4 with Priority: HIGHEST for action port [ 573.706994] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4 with Priority: HIGHEST for action port [ 573.707303] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.707436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.707534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.707729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.707809] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.212362] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4 [ 574.212362] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.212362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.212362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.212362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.212362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.212362] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4 already deleted. [ 574.212362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-650d0947-d7c8-42bb-bdf9-35b2dc6ac1c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.352090] env[65119]: INFO networking_nsxv3.common.synchronization [None req-cf3b2832-8572-460b-b415-1ef831cf7535 None None] Enqueued Resource ID: 4d92ce3a-9bb5-4c14-9990-890d8c5806de with Priority: HIGHEST for action port [ 575.352407] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d92ce3a-9bb5-4c14-9990-890d8c5806de with Priority: HIGHEST for action port [ 575.352951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d92ce3a-9bb5-4c14-9990-890d8c5806de taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.352951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d92ce3a-9bb5-4c14-9990-890d8c5806de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.353077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d92ce3a-9bb5-4c14-9990-890d8c5806de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.353355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d92ce3a-9bb5-4c14-9990-890d8c5806de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.353492] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d92ce3a-9bb5-4c14-9990-890d8c5806de',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.855997] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d92ce3a-9bb5-4c14-9990-890d8c5806de [ 575.855997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.856134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.856178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.856598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.856598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.856598] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d92ce3a-9bb5-4c14-9990-890d8c5806de already deleted. [ 575.856743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d92ce3a-9bb5-4c14-9990-890d8c5806de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.967225] env[65119]: INFO networking_nsxv3.common.synchronization [None req-f85d6870-3dd2-415a-898a-1c59ea27316a None None] Enqueued Resource ID: a9a1e51b-c177-4e14-a36a-7a38fdbf1a63 with Priority: HIGHEST for action port [ 577.967225] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a1e51b-c177-4e14-a36a-7a38fdbf1a63 with Priority: HIGHEST for action port [ 577.968291] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9a1e51b-c177-4e14-a36a-7a38fdbf1a63 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.968291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9a1e51b-c177-4e14-a36a-7a38fdbf1a63" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.968291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9a1e51b-c177-4e14-a36a-7a38fdbf1a63" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.968291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9a1e51b-c177-4e14-a36a-7a38fdbf1a63" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.968291] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9a1e51b-c177-4e14-a36a-7a38fdbf1a63',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.264267] env[65119]: INFO networking_nsxv3.common.synchronization [None req-5cecc150-30e8-43d8-91b6-37c8825af402 None None] Enqueued Resource ID: f0e2d5d6-fe1b-4dc9-8887-01de486b0317 with Priority: HIGHEST for action port [ 578.264391] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2d5d6-fe1b-4dc9-8887-01de486b0317 with Priority: HIGHEST for action port [ 578.265080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0e2d5d6-fe1b-4dc9-8887-01de486b0317 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.265247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0e2d5d6-fe1b-4dc9-8887-01de486b0317" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.265247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0e2d5d6-fe1b-4dc9-8887-01de486b0317" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.266586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0e2d5d6-fe1b-4dc9-8887-01de486b0317" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.266703] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0e2d5d6-fe1b-4dc9-8887-01de486b0317',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.471117] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9a1e51b-c177-4e14-a36a-7a38fdbf1a63 [ 578.471877] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.472178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.472369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.472660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.473093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.473093] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9a1e51b-c177-4e14-a36a-7a38fdbf1a63 already deleted. [ 578.473093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9a1e51b-c177-4e14-a36a-7a38fdbf1a63" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.768745] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0e2d5d6-fe1b-4dc9-8887-01de486b0317 [ 578.769151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.769308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.769404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.769669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.769669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.769758] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0e2d5d6-fe1b-4dc9-8887-01de486b0317 already deleted. [ 578.769845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0e2d5d6-fe1b-4dc9-8887-01de486b0317" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.933801] env[65119]: INFO networking_nsxv3.common.synchronization [None req-47f71868-5c94-4f19-9d92-1cbf890161e7 None None] Enqueued Resource ID: 716707fe-28c3-4cb2-85c8-63f1dd0bfd54 with Priority: HIGHEST for action port [ 578.934405] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716707fe-28c3-4cb2-85c8-63f1dd0bfd54 with Priority: HIGHEST for action port [ 578.934722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-716707fe-28c3-4cb2-85c8-63f1dd0bfd54 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.934826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-716707fe-28c3-4cb2-85c8-63f1dd0bfd54" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.934891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-716707fe-28c3-4cb2-85c8-63f1dd0bfd54" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.940022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-716707fe-28c3-4cb2-85c8-63f1dd0bfd54" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.940022] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716707fe-28c3-4cb2-85c8-63f1dd0bfd54',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.439023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 716707fe-28c3-4cb2-85c8-63f1dd0bfd54 [ 579.439291] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.439404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.439450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.439654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.439746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.439983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:716707fe-28c3-4cb2-85c8-63f1dd0bfd54 already deleted. [ 579.439983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-716707fe-28c3-4cb2-85c8-63f1dd0bfd54" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.921187] env[65119]: INFO networking_nsxv3.common.synchronization [req-4486c641-7666-4700-a25d-efea5b16a071 req-66ffb7b0-1b27-478f-9ca6-38fda8d1fb2d tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: a699cfd9-33dc-45bd-96cd-04b5f93193ab with Priority: HIGHEST for action security_group_rules [ 579.922141] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a699cfd9-33dc-45bd-96cd-04b5f93193ab with Priority: HIGHEST for action security_group_rules [ 579.922141] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a699cfd9-33dc-45bd-96cd-04b5f93193ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.922141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a699cfd9-33dc-45bd-96cd-04b5f93193ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.922141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a699cfd9-33dc-45bd-96cd-04b5f93193ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.922141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a699cfd9-33dc-45bd-96cd-04b5f93193ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.922141] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a699cfd9-33dc-45bd-96cd-04b5f93193ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.020637] env[65119]: INFO networking_nsxv3.common.synchronization [None req-be29c152-b616-4b1a-a548-dd2ea1b6cb9c None None] Enqueued Resource ID: 1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4 with Priority: HIGHEST for action port [ 580.021227] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4 with Priority: HIGHEST for action port [ 580.021407] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.021561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.021595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.021815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.021892] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.445863] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.445863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.445863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.445863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.445863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.445863] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a699cfd9-33dc-45bd-96cd-04b5f93193ab already deleted. [ 580.445863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a699cfd9-33dc-45bd-96cd-04b5f93193ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.524061] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4 [ 580.524865] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.524865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.524865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.524865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.524865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.524865] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4 already deleted. [ 580.525396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dac5c3a-a4d6-40da-8043-a07e6e0dc1f4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.658839] env[65119]: INFO networking_nsxv3.common.synchronization [None req-41a48915-78e2-4b28-81cc-d5d44e93f8aa None None] Enqueued Resource ID: 5e83c1da-d03e-4db2-b96b-5906c1145208 with Priority: HIGHEST for action port [ 580.659293] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e83c1da-d03e-4db2-b96b-5906c1145208 with Priority: HIGHEST for action port [ 580.660039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e83c1da-d03e-4db2-b96b-5906c1145208 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.660039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e83c1da-d03e-4db2-b96b-5906c1145208" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.660039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e83c1da-d03e-4db2-b96b-5906c1145208" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.660039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e83c1da-d03e-4db2-b96b-5906c1145208" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.660438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e83c1da-d03e-4db2-b96b-5906c1145208',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.834983] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c6e0941a-78e6-4558-b916-13b810c0759c None None] Enqueued Resource ID: cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8 with Priority: HIGHEST for action port [ 580.835153] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8 with Priority: HIGHEST for action port [ 580.835719] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.835845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.835908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.836182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.836301] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.167175] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e83c1da-d03e-4db2-b96b-5906c1145208 [ 581.167380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.167613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.167613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.167994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.167994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.167994] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e83c1da-d03e-4db2-b96b-5906c1145208 already deleted. [ 581.168199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e83c1da-d03e-4db2-b96b-5906c1145208" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.340825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8 [ 581.340825] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.340825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.340825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.340825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.340825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.340825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8 already deleted. [ 581.340825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfaf6fd4-4939-42d2-81c5-8c97a7d10ad8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.835511] env[65119]: INFO networking_nsxv3.common.synchronization [None req-321bab2e-5104-45db-8828-66bfcb0865bf None None] Enqueued Resource ID: aed49f60-4c11-4767-bac2-377dfe6c5134 with Priority: HIGHEST for action port [ 582.835511] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed49f60-4c11-4767-bac2-377dfe6c5134 with Priority: HIGHEST for action port [ 582.835511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed49f60-4c11-4767-bac2-377dfe6c5134 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.835511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed49f60-4c11-4767-bac2-377dfe6c5134" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.835946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed49f60-4c11-4767-bac2-377dfe6c5134" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.835946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed49f60-4c11-4767-bac2-377dfe6c5134" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.835946] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed49f60-4c11-4767-bac2-377dfe6c5134',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.337595] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aed49f60-4c11-4767-bac2-377dfe6c5134 [ 583.340779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.340857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.340931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.341706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.341706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.341706] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aed49f60-4c11-4767-bac2-377dfe6c5134 already deleted. [ 583.341706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed49f60-4c11-4767-bac2-377dfe6c5134" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.685023] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6852a74b-1f6a-4081-9f37-8b18493974cc None None] Enqueued Resource ID: 7355b096-122d-4a22-a632-06b87a925b38 with Priority: HIGHEST for action port [ 583.685023] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7355b096-122d-4a22-a632-06b87a925b38 with Priority: HIGHEST for action port [ 583.685023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7355b096-122d-4a22-a632-06b87a925b38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.685023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7355b096-122d-4a22-a632-06b87a925b38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.685023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7355b096-122d-4a22-a632-06b87a925b38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.685612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7355b096-122d-4a22-a632-06b87a925b38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.686016] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7355b096-122d-4a22-a632-06b87a925b38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.191553] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7355b096-122d-4a22-a632-06b87a925b38 [ 584.192057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.192057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.192057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.195175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.195175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.195175] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7355b096-122d-4a22-a632-06b87a925b38 already deleted. [ 584.195175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7355b096-122d-4a22-a632-06b87a925b38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.540898] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43e1b09c-06f1-489c-9d10-6b62bc99225c None None] Enqueued Resource ID: 4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb with Priority: HIGHEST for action port [ 584.541942] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb with Priority: HIGHEST for action port [ 584.543425] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.543425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.543425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.543425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.543425] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.795646] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9b72ecfc-4dce-446f-900d-f7120822040c None None] Enqueued Resource ID: aa8a3237-5f85-4991-9596-5b963efba523 with Priority: HIGHEST for action port [ 584.796025] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a3237-5f85-4991-9596-5b963efba523 with Priority: HIGHEST for action port [ 584.796567] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa8a3237-5f85-4991-9596-5b963efba523 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.796653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa8a3237-5f85-4991-9596-5b963efba523" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.796714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa8a3237-5f85-4991-9596-5b963efba523" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.801064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa8a3237-5f85-4991-9596-5b963efba523" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.801064] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8a3237-5f85-4991-9596-5b963efba523',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.052314] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb [ 585.052314] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.052314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.053200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.053200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.053200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.053200] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb already deleted. [ 585.053200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff0d6f3-96a5-4b4c-abb9-b4442a1cc0fb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.303766] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa8a3237-5f85-4991-9596-5b963efba523 [ 585.304204] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.304282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.304320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.304536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.304625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.305169] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa8a3237-5f85-4991-9596-5b963efba523 already deleted. [ 585.305169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa8a3237-5f85-4991-9596-5b963efba523" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.112263] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a6130c6c-fd94-4c24-b0bb-1eb600b8a451 None None] Enqueued Resource ID: 5df2e222-2fa2-46e3-b3a2-138b3784a876 with Priority: HIGHEST for action port [ 586.112263] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5df2e222-2fa2-46e3-b3a2-138b3784a876 with Priority: HIGHEST for action port [ 586.112263] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5df2e222-2fa2-46e3-b3a2-138b3784a876 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.112263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5df2e222-2fa2-46e3-b3a2-138b3784a876" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.112263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5df2e222-2fa2-46e3-b3a2-138b3784a876" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.112947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5df2e222-2fa2-46e3-b3a2-138b3784a876" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.113239] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df2e222-2fa2-46e3-b3a2-138b3784a876',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.156162] env[65119]: INFO networking_nsxv3.common.synchronization [None req-abac312e-86bd-49c4-a431-d449cc83c0c8 None None] Enqueued Resource ID: 776cabd0-aef0-45a1-9306-9f7055981742 with Priority: HIGHEST for action port [ 586.156162] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 776cabd0-aef0-45a1-9306-9f7055981742 with Priority: HIGHEST for action port [ 586.156162] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-776cabd0-aef0-45a1-9306-9f7055981742 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.156341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-776cabd0-aef0-45a1-9306-9f7055981742" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.156341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-776cabd0-aef0-45a1-9306-9f7055981742" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.156591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-776cabd0-aef0-45a1-9306-9f7055981742" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.156673] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('776cabd0-aef0-45a1-9306-9f7055981742',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.617154] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5df2e222-2fa2-46e3-b3a2-138b3784a876 [ 586.617459] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.617529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.617652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.617798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.617895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.617990] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5df2e222-2fa2-46e3-b3a2-138b3784a876 already deleted. [ 586.618141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5df2e222-2fa2-46e3-b3a2-138b3784a876" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.658930] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 776cabd0-aef0-45a1-9306-9f7055981742 [ 586.659085] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.659588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.659588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.659588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.659588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.659760] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:776cabd0-aef0-45a1-9306-9f7055981742 already deleted. [ 586.659760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-776cabd0-aef0-45a1-9306-9f7055981742" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.878027] env[65119]: INFO networking_nsxv3.common.synchronization [req-4e8168c0-a71f-428d-a817-44f53b0ca0e2 req-22721c3b-1d75-4bbd-86a5-de32a8c60221 tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: cc27c82d-ad61-454a-8066-2aad82d14f22 with Priority: HIGHEST for action security_group_rules [ 586.878027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc27c82d-ad61-454a-8066-2aad82d14f22 with Priority: HIGHEST for action security_group_rules [ 586.878027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc27c82d-ad61-454a-8066-2aad82d14f22 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.879271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc27c82d-ad61-454a-8066-2aad82d14f22" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.879354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc27c82d-ad61-454a-8066-2aad82d14f22" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.879614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc27c82d-ad61-454a-8066-2aad82d14f22" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.879706] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc27c82d-ad61-454a-8066-2aad82d14f22',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.407876] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.407876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.407876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.407876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.407876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.407876] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc27c82d-ad61-454a-8066-2aad82d14f22 already deleted. [ 587.407876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc27c82d-ad61-454a-8066-2aad82d14f22" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.945845] env[65119]: INFO networking_nsxv3.common.synchronization [None req-4d16f844-7d62-4e08-a391-30fee87c1663 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 587.946749] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 587.947890] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.947890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.947890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.948036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.948132] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.051731] env[65119]: INFO networking_nsxv3.common.synchronization [None req-d501244e-c168-4dbb-a983-7893c5e6cb53 None None] Enqueued Resource ID: ca2a83f7-8645-4054-8176-71b1124a1a70 with Priority: HIGHEST for action port [ 588.053858] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2a83f7-8645-4054-8176-71b1124a1a70 with Priority: HIGHEST for action port [ 588.053858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca2a83f7-8645-4054-8176-71b1124a1a70 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.053858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca2a83f7-8645-4054-8176-71b1124a1a70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.053858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca2a83f7-8645-4054-8176-71b1124a1a70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.055434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca2a83f7-8645-4054-8176-71b1124a1a70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.055434] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2a83f7-8645-4054-8176-71b1124a1a70',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.059828] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ba25e107-9481-43ee-ae4f-1d358748bf42 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 588.061177] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 588.061499] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.062737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.318619] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ba8b2bf4-084f-4c64-9728-eeaf7b5edd0d None None] Enqueued Resource ID: b06aea23-c90a-4247-87fd-880a68831d4f with Priority: HIGHEST for action port [ 588.319251] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b06aea23-c90a-4247-87fd-880a68831d4f with Priority: HIGHEST for action port [ 588.319623] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b06aea23-c90a-4247-87fd-880a68831d4f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.319757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b06aea23-c90a-4247-87fd-880a68831d4f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.319757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b06aea23-c90a-4247-87fd-880a68831d4f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.320200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b06aea23-c90a-4247-87fd-880a68831d4f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.321212] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06aea23-c90a-4247-87fd-880a68831d4f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.472958] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.473089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.473190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.473410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.473722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.473722] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e already deleted. [ 588.473722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.473838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.473998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.473998] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.560503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca2a83f7-8645-4054-8176-71b1124a1a70 [ 588.560503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.560503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.560503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.560503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.560503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.560503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca2a83f7-8645-4054-8176-71b1124a1a70 already deleted. [ 588.560503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca2a83f7-8645-4054-8176-71b1124a1a70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.824467] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b06aea23-c90a-4247-87fd-880a68831d4f [ 588.824819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.825068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.825068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.825289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.825379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.825477] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b06aea23-c90a-4247-87fd-880a68831d4f already deleted. [ 588.825678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b06aea23-c90a-4247-87fd-880a68831d4f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.996339] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.997083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.997083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.997083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.997083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.997083] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e already deleted. [ 588.997083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.905477] env[65119]: INFO networking_nsxv3.common.synchronization [req-2cd80af5-3f8a-4d20-907e-0e98c00712da req-19ce2c3a-1201-4026-9f9f-c99e6ad8e0f4 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 589.905894] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 589.906671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.906807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.906872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.907471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.908060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.908209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.908300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.908436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.908767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.908767] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.395676] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8b9c8761-b8e7-484a-8d15-a71741661c39 tempest-VolumesAssistedSnapshotsTest-1186702850 tempest-VolumesAssistedSnapshotsTest-1186702850-project-member] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 590.395676] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 590.395676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.395676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.395969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.396112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.396160] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.410895] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.411139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.411139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.411363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.411480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.411935] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.412065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.412133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.412303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.412384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.412470] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 already deleted. [ 590.412553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.536321] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-358 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.536682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.536682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.537070] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.537394] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.537394] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.537540] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.537708] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.537896] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.538150] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.538261] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.538369] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.538468] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.538603] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.538709] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.538840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.559991] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.560111] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.560249] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.560423] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.560967] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.560967] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.561129] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.561613] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.561751] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6054f8-a778-4c23-9d8f-b57e02b70a2d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.564981] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6bce7bd4-e84c-4d13-b266-2a5897836fc9 tempest-VolumesAssistedSnapshotsTest-1186702850 tempest-VolumesAssistedSnapshotsTest-1186702850-project-member] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 590.564981] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 590.565435] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.565435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.918925] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.919097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.919164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.919377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.919472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.919568] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 already deleted. [ 590.919652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.919810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.919963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.920056] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.068021] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.068250] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.068382] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.068682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.068859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.069034] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 2a6054f8-a778-4c23-9d8f-b57e02b70a2d not found, creating... [ 591.069390] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.069567] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.069738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.070079] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.070234] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.070713] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.070927] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.071089] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.071309] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.071444] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.071582] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 2a6054f8-a778-4c23-9d8f-b57e02b70a2d is going to be created. [ 591.093349] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.093612] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.093834] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.094307] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.094544] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.094780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.441792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.442154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.442189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.442469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.442581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.442837] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 already deleted. [ 591.442960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.904377] env[65119]: INFO networking_nsxv3.common.synchronization [req-2cd80af5-3f8a-4d20-907e-0e98c00712da req-cbfb9e32-19aa-4bc7-817c-43fc118d85c2 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 591.904608] env[65119]: INFO networking_nsxv3.common.synchronization [req-2cd80af5-3f8a-4d20-907e-0e98c00712da req-cbfb9e32-19aa-4bc7-817c-43fc118d85c2 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 591.904712] env[65119]: INFO networking_nsxv3.common.synchronization [req-2cd80af5-3f8a-4d20-907e-0e98c00712da req-cbfb9e32-19aa-4bc7-817c-43fc118d85c2 service nova] Enqueued Resource ID: 2a6054f8-a778-4c23-9d8f-b57e02b70a2d with Priority: HIGHEST for action port [ 591.905235] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 591.905377] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 591.905475] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a6054f8-a778-4c23-9d8f-b57e02b70a2d with Priority: HIGHEST for action port [ 591.905737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.905867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.905957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.906292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.906402] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.907187] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.907323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.907399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.907576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.907723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.907820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.907883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.908046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.908134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.908226] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.909241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.909354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.909482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.909568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.909642] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6054f8-a778-4c23-9d8f-b57e02b70a2d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.085670] env[65119]: INFO networking_nsxv3.common.synchronization [req-48cae3e2-8f40-487a-8efe-947e914222c0 req-faf82620-6bda-4f71-8e21-6f7e083766d0 tempest-ServerDiagnosticsTest-1101170317 tempest-ServerDiagnosticsTest-1101170317-project-member] Enqueued Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 592.085670] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 592.086852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.086852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.086852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.086852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.088417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.088417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.088417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.088417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.088417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.088417] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.412048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.412180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.426679] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.428027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a6054f8-a778-4c23-9d8f-b57e02b70a2d with status ACTIVE [ 592.428027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.428192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.428192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.428343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.428432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.428599] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.428707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.428758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.428892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.428965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.429191] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.429291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.429291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.430245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.430245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.430245] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a6054f8-a778-4c23-9d8f-b57e02b70a2d is going to be updated. [ 592.451617] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.451941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.451941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.452020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.452121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.452275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a6054f8-a778-4c23-9d8f-b57e02b70a2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.591713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.591926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.592032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.593059] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.593059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.593426] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7c347da-631c-445c-b2e6-004a6894e069 already deleted. [ 592.593426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.656026] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.656026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.656026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.656026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.656514] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.656952] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.657520] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.657883] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.658153] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.658479] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.658720] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.659139] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.659341] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.659551] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.659744] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.659970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.684106] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.684106] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.684106] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.684106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.684106] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-e8edc799-6749-4015-ab61-f0a747cdf9c4 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.684106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.684106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.684106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.684106] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8edc799-6749-4015-ab61-f0a747cdf9c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.933084] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.186079] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.186366] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.186494] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.186805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.186976] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.187150] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port e8edc799-6749-4015-ab61-f0a747cdf9c4 not found, creating... [ 593.187623] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.187788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.187788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.188009] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.188176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.188480] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.188715] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.188816] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.189064] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.189207] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.189386] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: e8edc799-6749-4015-ab61-f0a747cdf9c4 is going to be created. [ 593.211455] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.211455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.211455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.211627] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.211873] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.212150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.435454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.435454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.435648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.435794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.435941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.436129] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be created. [ 593.463869] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.464325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.464325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.464409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.464550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.475342] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: UNINITIALIZED for 2s [ 593.965070] env[65119]: INFO networking_nsxv3.common.synchronization [req-48cae3e2-8f40-487a-8efe-947e914222c0 req-45d89661-1a4e-4860-a8b2-08324c8ce74f service nova] Enqueued Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_rules [ 593.965262] env[65119]: INFO networking_nsxv3.common.synchronization [req-48cae3e2-8f40-487a-8efe-947e914222c0 req-45d89661-1a4e-4860-a8b2-08324c8ce74f service nova] Enqueued Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 593.965446] env[65119]: INFO networking_nsxv3.common.synchronization [req-48cae3e2-8f40-487a-8efe-947e914222c0 req-45d89661-1a4e-4860-a8b2-08324c8ce74f service nova] Enqueued Resource ID: e8edc799-6749-4015-ab61-f0a747cdf9c4 with Priority: HIGHEST for action port [ 593.966015] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_rules [ 593.968678] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 593.969164] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8edc799-6749-4015-ab61-f0a747cdf9c4 with Priority: HIGHEST for action port [ 593.969735] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.969867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.969930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.970200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.970285] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.971167] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.971285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.971351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.973037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.973037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.973037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.973037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.973037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.973037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.973037] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.974366] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8edc799-6749-4015-ab61-f0a747cdf9c4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.974697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.974864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.976095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.976095] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8edc799-6749-4015-ab61-f0a747cdf9c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.478802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.479146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.479146] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.479996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8edc799-6749-4015-ab61-f0a747cdf9c4 with status ACTIVE [ 594.480181] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.480303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.480399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.481692] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.481692] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.481692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.482129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.482129] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8edc799-6749-4015-ab61-f0a747cdf9c4 is going to be updated. [ 594.503785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.503785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.503785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8edc799-6749-4015-ab61-f0a747cdf9c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.577852] env[65119]: INFO networking_nsxv3.common.synchronization [req-06028f8d-d9e5-4f82-8964-1b5cae861f48 req-7a697ddb-4d71-4263-a046-d4e8ed4ce31b tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: eb6bbf53-dd37-4960-aba0-82b45b274ace with Priority: HIGHEST for action security_group_rules [ 594.578444] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb6bbf53-dd37-4960-aba0-82b45b274ace with Priority: HIGHEST for action security_group_rules [ 594.578788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb6bbf53-dd37-4960-aba0-82b45b274ace taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.578897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb6bbf53-dd37-4960-aba0-82b45b274ace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.578966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb6bbf53-dd37-4960-aba0-82b45b274ace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.579772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb6bbf53-dd37-4960-aba0-82b45b274ace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.579913] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb6bbf53-dd37-4960-aba0-82b45b274ace',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.985438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.101408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.101590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.101640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.101858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.101953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.102069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb6bbf53-dd37-4960-aba0-82b45b274ace already deleted. [ 595.102172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb6bbf53-dd37-4960-aba0-82b45b274ace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.486675] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 595.487060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.487060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.487280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.487442] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.487561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.487625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.487770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.487848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.487936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.488028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.489047] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.489169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.489235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.489388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.489468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.489554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7c347da-631c-445c-b2e6-004a6894e069 is going to be created. [ 595.512948] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.513119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.513119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.513360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.513431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.523300] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: UNINITIALIZED for 2s [ 595.552650] env[65119]: INFO networking_nsxv3.common.synchronization [None req-cf4aaf96-cbf9-49a3-b3a5-7bdd2d82c7e8 None None] Enqueued Resource ID: 858574cc-3616-49d9-b865-ba03ccfd26f5 with Priority: HIGHEST for action port [ 595.553190] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858574cc-3616-49d9-b865-ba03ccfd26f5 with Priority: HIGHEST for action port [ 595.553996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-858574cc-3616-49d9-b865-ba03ccfd26f5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.553996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-858574cc-3616-49d9-b865-ba03ccfd26f5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.553996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-858574cc-3616-49d9-b865-ba03ccfd26f5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.553996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-858574cc-3616-49d9-b865-ba03ccfd26f5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.553996] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('858574cc-3616-49d9-b865-ba03ccfd26f5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.991552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.991731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.991784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.991962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.992141] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.992260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.992333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.992444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.992534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.992622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.992892] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.992892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.992981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.993084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.993206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.993297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.993360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.993496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.993557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.993624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.993709] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.055974] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 858574cc-3616-49d9-b865-ba03ccfd26f5 [ 596.056215] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.056390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.056461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.056688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.056782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.056877] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:858574cc-3616-49d9-b865-ba03ccfd26f5 already deleted. [ 596.057171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-858574cc-3616-49d9-b865-ba03ccfd26f5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.417057] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8bc6ab6-858b-4420-b590-c4211e97c338 req-f3385c9b-27ba-4175-85e6-e1a8c8ff815b tempest-DeleteServersAdminTestJSON-506825564 tempest-DeleteServersAdminTestJSON-506825564-project-member] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 596.417610] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 596.417915] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.419246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.419246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.419846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.419846] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.419846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.419846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.420054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.420128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.420223] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.498395] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a32e7cc-5871-4cac-93b4-13eb1e04d001: rpc.has_security_group_logging(os_id): False [ 596.519945] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.519945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.519945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.520261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.520406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.520851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.520851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.520851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.521080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.522036] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.522036] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.522036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.524581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.524719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.524871] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be created. [ 596.586908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.587093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.587140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.587405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.587597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.599759] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 596.809017] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.809164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.809312] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.809583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.809886] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.810053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.810171] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.810394] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.810558] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.810917] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.810917] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.810917] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.811063] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.811977] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.811977] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.811977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.833656] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.833824] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.834053] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.834261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.834586] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-44f5e432-f2cc-4848-9bee-e37cdb058375 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.834757] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.834869] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.835615] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.835754] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f5e432-f2cc-4848-9bee-e37cdb058375',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.923312] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.924089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.924089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.924089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.924089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.924292] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.924361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.924427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.924605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.924706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.924812] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 already deleted. [ 596.924914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.339419] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.339659] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.339772] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.340049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.340190] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.340344] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 44f5e432-f2cc-4848-9bee-e37cdb058375 not found, creating... [ 597.340609] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.340759] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.340871] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.341100] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.341231] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.341556] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.341716] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.341826] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.342042] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.342171] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.342306] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 44f5e432-f2cc-4848-9bee-e37cdb058375 is going to be created. [ 597.371117] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.371399] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.372052] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.372420] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.374091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.374340] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.535493] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: SUCCESS [ 597.535804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.535881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.536141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.536372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.536489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.536625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.536790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.536875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.536963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.537065] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.942440] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0245a9a8-1e6d-4bcc-aabd-f9d49876ac88 None None] Enqueued Resource ID: aa3b271e-9d91-4f34-9af5-167896a4ea80 with Priority: HIGHEST for action port [ 597.943433] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3b271e-9d91-4f34-9af5-167896a4ea80 with Priority: HIGHEST for action port [ 597.943433] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa3b271e-9d91-4f34-9af5-167896a4ea80 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.943433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa3b271e-9d91-4f34-9af5-167896a4ea80" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.943433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa3b271e-9d91-4f34-9af5-167896a4ea80" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.943767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa3b271e-9d91-4f34-9af5-167896a4ea80" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.943767] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa3b271e-9d91-4f34-9af5-167896a4ea80',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.041784] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.043840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.043840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.043840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.043840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.044479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.044479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.044479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.044479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.044479] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.092017] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8bc6ab6-858b-4420-b590-c4211e97c338 req-47ec5978-0843-4afe-9ac1-616908e60bc7 service nova] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_rules [ 598.092307] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8bc6ab6-858b-4420-b590-c4211e97c338 req-47ec5978-0843-4afe-9ac1-616908e60bc7 service nova] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 598.092528] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8bc6ab6-858b-4420-b590-c4211e97c338 req-47ec5978-0843-4afe-9ac1-616908e60bc7 service nova] Enqueued Resource ID: 44f5e432-f2cc-4848-9bee-e37cdb058375 with Priority: HIGHEST for action port [ 598.094312] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_rules [ 598.094467] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 598.094642] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f5e432-f2cc-4848-9bee-e37cdb058375 with Priority: HIGHEST for action port [ 598.095656] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.096149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.096149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.096447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.096447] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.098126] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.098538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.098651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.099087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.099731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.099891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.100089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.100331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.100481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.100636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.101996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f5e432-f2cc-4848-9bee-e37cdb058375 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.101996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.101996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.102280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.102397] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f5e432-f2cc-4848-9bee-e37cdb058375',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.447273] env[65119]: INFO networking_nsxv3.common.synchronization [None req-868aa817-3736-4ac1-b708-90302d873da9 tempest-ServersTestBootFromVolume-80384451 tempest-ServersTestBootFromVolume-80384451-project-member] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 598.447607] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 598.447834] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa3b271e-9d91-4f34-9af5-167896a4ea80 [ 598.448674] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.449095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.449095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.449273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.449273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.449482] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa3b271e-9d91-4f34-9af5-167896a4ea80 already deleted. [ 598.449482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa3b271e-9d91-4f34-9af5-167896a4ea80" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.449698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.449778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.450132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.450132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.450251] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.547129] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7c347da-631c-445c-b2e6-004a6894e069: rpc.has_security_group_logging(os_id): False [ 598.565729] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.565890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.565963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.566253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.566456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.566688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.566795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.566863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.567030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.567109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.567289] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.567396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.567485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.567655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.567749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.567940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.568051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.568113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.568252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.568325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.568408] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7c347da-631c-445c-b2e6-004a6894e069 is going to be created. [ 598.604584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.604745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.605027] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.607159] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44f5e432-f2cc-4848-9bee-e37cdb058375 with status ACTIVE [ 598.607159] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.607159] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.607159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.607738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.607738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.607738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.607738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.607738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.607903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.607903] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44f5e432-f2cc-4848-9bee-e37cdb058375 is going to be updated. [ 598.624688] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 598.624927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.634103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.634206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.634267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.634464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.634741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.638102] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.638327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.638327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.638488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.638624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.638774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f5e432-f2cc-4848-9bee-e37cdb058375" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.649558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: IN_PROGRESS for 2s [ 598.688569] env[65119]: INFO networking_nsxv3.common.synchronization [None req-3f2af0e4-498c-4d1d-aed4-4d6c3c4bde5d tempest-ServersTestBootFromVolume-80384451 tempest-ServersTestBootFromVolume-80384451-project-member] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 598.689213] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 598.690219] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.690219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.971435] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.971646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.971646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.971851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.971943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.972052] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 already deleted. [ 598.972138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.972289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.972446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.972532] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.111123] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.495841] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.496028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.496103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.496331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.496441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.496525] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 already deleted. [ 599.496602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.613046] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.613336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.613336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.613858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.613858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.613858] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be created. [ 599.620945] env[65119]: INFO networking_nsxv3.common.synchronization [req-f900d13d-7ee8-4dc5-86b6-df4d3b2274b6 req-8812d128-456c-4666-9ff8-ccde348099fa tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 599.621678] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 599.622184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.622726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.622795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.623307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.623750] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.623925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.623969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.624196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.624259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.624398] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.638997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.639184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.639184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.639370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.639588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.649803] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: UNINITIALIZED for 2s [ 599.771631] env[65119]: INFO networking_nsxv3.common.synchronization [None req-aa7fcb67-3ac0-4faf-976d-2bdfa28874f0 None None] Enqueued Resource ID: ba0e452a-c431-4985-8564-2c9874faea4d with Priority: HIGHEST for action port [ 599.771631] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0e452a-c431-4985-8564-2c9874faea4d with Priority: HIGHEST for action port [ 599.771631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0e452a-c431-4985-8564-2c9874faea4d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.771631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0e452a-c431-4985-8564-2c9874faea4d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.771631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0e452a-c431-4985-8564-2c9874faea4d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.771914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0e452a-c431-4985-8564-2c9874faea4d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.771949] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0e452a-c431-4985-8564-2c9874faea4d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.127785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.127785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.127785] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 already deleted. [ 600.127785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.277470] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba0e452a-c431-4985-8564-2c9874faea4d [ 600.277691] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.277821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.277888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.278162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.278253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.278353] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba0e452a-c431-4985-8564-2c9874faea4d already deleted. [ 600.278431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0e452a-c431-4985-8564-2c9874faea4d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.443520] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.443701] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.443825] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.444139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.444427] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.444591] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.444718] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.444951] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.446386] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.446386] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.446386] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.446386] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.447979] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.447979] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.449134] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.449134] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.469687] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.471841] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.471841] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.471841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.471841] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-be5347ec-7014-4a74-b763-d9266ad83918 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.471841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.471841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.471841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.471841] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5347ec-7014-4a74-b763-d9266ad83918',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.661098] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: SUCCESS [ 600.661410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.981477] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.981477] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port be5347ec-7014-4a74-b763-d9266ad83918 not found, creating... [ 600.981477] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.981477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.981907] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.981907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.981907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.981907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.981907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.983927] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: be5347ec-7014-4a74-b763-d9266ad83918 is going to be created. [ 601.005156] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.005362] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.005509] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.005890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.006894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.006949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.603498] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ea2f195f-46e5-4dc5-ad53-f7918fda5164 None None] Enqueued Resource ID: 72e1b0f9-2972-428b-aaae-547de53ae3f2 with Priority: HIGHEST for action port [ 601.604062] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72e1b0f9-2972-428b-aaae-547de53ae3f2 with Priority: HIGHEST for action port [ 601.604380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-72e1b0f9-2972-428b-aaae-547de53ae3f2 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.604505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72e1b0f9-2972-428b-aaae-547de53ae3f2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.604573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72e1b0f9-2972-428b-aaae-547de53ae3f2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.604857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72e1b0f9-2972-428b-aaae-547de53ae3f2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.604944] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e1b0f9-2972-428b-aaae-547de53ae3f2',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.660792] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 601.661108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.661376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.661418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.662155] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.662155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.662155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.662155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.662155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.662155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.662441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.037295] env[65119]: INFO networking_nsxv3.common.synchronization [req-f900d13d-7ee8-4dc5-86b6-df4d3b2274b6 req-2d8bacc4-0081-4804-895f-1ef8a2488cc1 service nova] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_rules [ 602.037295] env[65119]: INFO networking_nsxv3.common.synchronization [req-f900d13d-7ee8-4dc5-86b6-df4d3b2274b6 req-2d8bacc4-0081-4804-895f-1ef8a2488cc1 service nova] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 602.037295] env[65119]: INFO networking_nsxv3.common.synchronization [req-f900d13d-7ee8-4dc5-86b6-df4d3b2274b6 req-2d8bacc4-0081-4804-895f-1ef8a2488cc1 service nova] Enqueued Resource ID: be5347ec-7014-4a74-b763-d9266ad83918 with Priority: HIGHEST for action port [ 602.039542] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_rules [ 602.039542] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 602.039542] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5347ec-7014-4a74-b763-d9266ad83918 with Priority: HIGHEST for action port [ 602.040545] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.040970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.041134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.043238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.043238] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.043812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.047224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.047344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.047523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.047763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.047826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.047919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.049313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.049313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.049313] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.049313] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-be5347ec-7014-4a74-b763-d9266ad83918 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.049313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.049696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.049696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.049696] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5347ec-7014-4a74-b763-d9266ad83918',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.109617] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72e1b0f9-2972-428b-aaae-547de53ae3f2 [ 602.111315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.111571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.111653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.111888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.111952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.112082] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72e1b0f9-2972-428b-aaae-547de53ae3f2 already deleted. [ 602.112254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72e1b0f9-2972-428b-aaae-547de53ae3f2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.164633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.164801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.165504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.165504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.165765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.165858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.165922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.166114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.166203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.166294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.166503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.166603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.166650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.166831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.166940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.167090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.167130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.167309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.167344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.167570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.167570] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.342799] env[65119]: INFO networking_nsxv3.common.synchronization [req-aaa93889-7ab9-4372-87dc-ea9c41b61c88 req-c0fe49f4-9e11-4f0e-9fe3-daafbbaf710b tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 602.343248] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 602.343577] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.343710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.343765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.344049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.346889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.347018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.347065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.347309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.347428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.347542] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.554145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.554145] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.554145] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be5347ec-7014-4a74-b763-d9266ad83918 with status ACTIVE [ 602.554145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.554145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.554145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.555515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.555621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.555695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.555865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.556302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.556302] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be5347ec-7014-4a74-b763-d9266ad83918 is going to be updated. [ 602.581051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.581496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.581674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.581813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.581965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.582143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be5347ec-7014-4a74-b763-d9266ad83918" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.657144] env[65119]: INFO networking_nsxv3.common.synchronization [None req-abb61a45-bd8a-401b-81d3-2dfcfa3e3097 None None] Enqueued Resource ID: d30a323a-6d04-4f15-9b40-d8f4d461b22e with Priority: HIGHEST for action port [ 602.658176] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30a323a-6d04-4f15-9b40-d8f4d461b22e with Priority: HIGHEST for action port [ 602.658765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d30a323a-6d04-4f15-9b40-d8f4d461b22e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.658765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d30a323a-6d04-4f15-9b40-d8f4d461b22e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.658765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d30a323a-6d04-4f15-9b40-d8f4d461b22e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.659136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d30a323a-6d04-4f15-9b40-d8f4d461b22e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.659136] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d30a323a-6d04-4f15-9b40-d8f4d461b22e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.670698] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1d77171-74cb-4523-ba62-d51303f9c0b4: rpc.has_security_group_logging(os_id): False [ 602.689012] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.689588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.689588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.689588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.689588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.689768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.689823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.689855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.689986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.690073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.690256] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.690350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.690410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.690551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.690627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.690828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.690920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.690981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.691870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.691990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.692128] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be created. [ 602.761125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.761219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.761219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.761434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.761646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.774641] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 602.850515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.850515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.850515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.850722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.850813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.851026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.851121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.851185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.851334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.851410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.851495] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 already deleted. [ 602.851575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.853530] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.853701] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.853822] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.854126] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.854382] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.854526] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.854637] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.855235] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.855235] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.855471] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.855471] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.855741] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.855741] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.855741] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.855849] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.855893] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.882174] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.882342] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.882480] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.882702] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.883198] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.883437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.883563] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.884040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.884907] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.060121] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.163669] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d30a323a-6d04-4f15-9b40-d8f4d461b22e [ 603.163669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.163669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.163669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.163669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.163669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.163669] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d30a323a-6d04-4f15-9b40-d8f4d461b22e already deleted. [ 603.163669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d30a323a-6d04-4f15-9b40-d8f4d461b22e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.388396] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.388613] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.388766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.389071] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.389218] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.389385] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 not found, creating... [ 603.389645] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.389780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.389886] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.390118] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.390247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.390517] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.390667] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.390779] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.391040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.391182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.391319] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 is going to be created. [ 603.412517] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.412767] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.412890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.413196] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.413405] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.413619] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.562967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.562967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.562967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.562967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.566814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.566814] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be created. [ 603.608156] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.608156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.608156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.608156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.608156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.620221] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: UNINITIALIZED for 2s [ 603.986771] env[65119]: INFO networking_nsxv3.common.synchronization [req-4d6d836c-6f9f-467a-bec1-8eb8ee0ad330 req-a2f3b7f8-d0c1-431c-96ba-139bb48632d3 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 603.986771] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 603.986771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.986771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.986771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.986771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.986771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.986771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.986771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.988475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.988475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.988475] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.172064] env[65119]: INFO networking_nsxv3.common.synchronization [req-aaa93889-7ab9-4372-87dc-ea9c41b61c88 req-2aeddbf1-4128-4677-b5ac-85f9de38de44 service nova] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 604.172064] env[65119]: INFO networking_nsxv3.common.synchronization [req-aaa93889-7ab9-4372-87dc-ea9c41b61c88 req-2aeddbf1-4128-4677-b5ac-85f9de38de44 service nova] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 604.172466] env[65119]: INFO networking_nsxv3.common.synchronization [req-aaa93889-7ab9-4372-87dc-ea9c41b61c88 req-2aeddbf1-4128-4677-b5ac-85f9de38de44 service nova] Enqueued Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 604.173462] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 604.173752] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 604.176297] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 604.176297] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.176297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.176297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.176297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.176297] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.177391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.177650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.177802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.178096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.178358] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.178679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.178905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.179243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.179449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.179658] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.181185] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.181185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.181185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.181456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.181651] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.491080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.491080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.491080] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e already deleted. [ 604.491080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.506617] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.507111] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.507375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.507903] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.508342] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.508699] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.509036] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.509457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.509775] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.510230] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.510481] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.511016] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.511016] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.511016] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.511413] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.513173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.538276] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.538485] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.538685] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.539233] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.541874] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-4564f450-7385-434b-b41b-927d7031ad94 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.541874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.541874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.541874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.541874] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4564f450-7385-434b-b41b-927d7031ad94',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.684706] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.684954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.685170] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.687780] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with status ACTIVE [ 604.688044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.688172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.688225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.688472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.688607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.688864] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.689428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.689428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.689428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.689428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.689564] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.689617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.690070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.690070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.690070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.690070] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 is going to be updated. [ 604.718470] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.718470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.718470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.718730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.718775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.719325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.720857] env[65119]: INFO networking_nsxv3.common.synchronization [req-cf63c829-2d53-4d29-bee2-db1dc46b6f56 req-c26b2b3e-d86f-4fe7-922a-fb2dc623a7dd tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: cdb1869e-599e-4869-ab95-c79d50868bea with Priority: HIGHEST for action security_group_rules [ 604.722178] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb1869e-599e-4869-ab95-c79d50868bea with Priority: HIGHEST for action security_group_rules [ 604.722720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb1869e-599e-4869-ab95-c79d50868bea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.723136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb1869e-599e-4869-ab95-c79d50868bea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.723215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb1869e-599e-4869-ab95-c79d50868bea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.723459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb1869e-599e-4869-ab95-c79d50868bea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.723546] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb1869e-599e-4869-ab95-c79d50868bea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.790109] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e40300dc-a6f4-4ac8-b4b3-5e371a0ec333 None None] Enqueued Resource ID: d6c1e83f-81a1-4186-8c14-87b00e3239b0 with Priority: HIGHEST for action port [ 604.791684] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 604.791927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.793046] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1e83f-81a1-4186-8c14-87b00e3239b0 with Priority: HIGHEST for action port [ 604.793389] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6c1e83f-81a1-4186-8c14-87b00e3239b0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.793513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6c1e83f-81a1-4186-8c14-87b00e3239b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.793579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6c1e83f-81a1-4186-8c14-87b00e3239b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.794337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6c1e83f-81a1-4186-8c14-87b00e3239b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.794337] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c1e83f-81a1-4186-8c14-87b00e3239b0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.049030] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.049030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 4564f450-7385-434b-b41b-927d7031ad94 not found, creating... [ 605.049030] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.049030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.050110] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.050110] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.050940] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.052857] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.053047] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.053249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 4564f450-7385-434b-b41b-927d7031ad94 is going to be created. [ 605.078538] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.078767] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.078891] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.079218] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.079593] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.079710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.187636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.253873] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.254079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.254158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.254455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.254527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.254607] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb1869e-599e-4869-ab95-c79d50868bea already deleted. [ 605.254697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb1869e-599e-4869-ab95-c79d50868bea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.296681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6c1e83f-81a1-4186-8c14-87b00e3239b0 [ 605.296681] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.296854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.296894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.297417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.297417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.297417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6c1e83f-81a1-4186-8c14-87b00e3239b0 already deleted. [ 605.297417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6c1e83f-81a1-4186-8c14-87b00e3239b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.632056] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 605.632056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.632380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.632903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.632903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.632903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.633224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.633224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.633224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.633329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.635264] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.693719] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.693719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.693719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.693719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.693719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.693719] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be created. [ 605.727658] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.727658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.727658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.727658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.727658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.737440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: UNINITIALIZED for 2s [ 605.803149] env[65119]: INFO networking_nsxv3.common.synchronization [req-4d6d836c-6f9f-467a-bec1-8eb8ee0ad330 req-df5efafd-f332-4517-ba58-d81ea94c9f0d service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 605.803536] env[65119]: INFO networking_nsxv3.common.synchronization [req-4d6d836c-6f9f-467a-bec1-8eb8ee0ad330 req-df5efafd-f332-4517-ba58-d81ea94c9f0d service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 605.803758] env[65119]: INFO networking_nsxv3.common.synchronization [req-4d6d836c-6f9f-467a-bec1-8eb8ee0ad330 req-df5efafd-f332-4517-ba58-d81ea94c9f0d service nova] Enqueued Resource ID: 4564f450-7385-434b-b41b-927d7031ad94 with Priority: HIGHEST for action port [ 605.804529] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 605.804695] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 605.804843] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4564f450-7385-434b-b41b-927d7031ad94 with Priority: HIGHEST for action port [ 605.805332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.805439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.805496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.805772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.805864] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.806961] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.807055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.807126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.807713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.807713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.807713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.808195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.808195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.808195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.808195] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.811416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4564f450-7385-434b-b41b-927d7031ad94 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.811416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.811416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.811416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.811416] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4564f450-7385-434b-b41b-927d7031ad94',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.137996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.138485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.138485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.138611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.138835] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.139052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.139125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.139323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.139466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.139589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.139813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.139943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.140046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.140243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.140828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.141599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.141723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.141933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.142071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.142188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.142293] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.312011] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.312288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.315580] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.316756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4564f450-7385-434b-b41b-927d7031ad94 with status ACTIVE [ 606.317057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.317223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.317223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.317610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.317610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.317720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.317833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.318939] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.318939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.318939] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4564f450-7385-434b-b41b-927d7031ad94 is going to be updated. [ 606.366730] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.367093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.367093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.367407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.367407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.367637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4564f450-7385-434b-b41b-927d7031ad94" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.646276] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31ff7630-123f-4898-982a-bb6d45f72689: rpc.has_security_group_logging(os_id): False [ 606.666826] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.666959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.667374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.667374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.667550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.667807] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.667926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.667993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.668167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.668246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.668565] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.668711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.668794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.668944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.669032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.669209] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.669304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.669365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.669505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.669598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.669681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be created. [ 606.721865] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8e1fcf69-08a8-4145-916d-06392a6201b9 None None] Enqueued Resource ID: 9a487cd5-3889-4958-8d55-905893da1206 with Priority: HIGHEST for action port [ 606.722708] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a487cd5-3889-4958-8d55-905893da1206 with Priority: HIGHEST for action port [ 606.723180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a487cd5-3889-4958-8d55-905893da1206 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.723294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a487cd5-3889-4958-8d55-905893da1206" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.723395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a487cd5-3889-4958-8d55-905893da1206" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.723645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a487cd5-3889-4958-8d55-905893da1206" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.723941] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a487cd5-3889-4958-8d55-905893da1206',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.735416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.735582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.735628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.735822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.736012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.749803] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 606.821168] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.036824] env[65119]: INFO networking_nsxv3.common.synchronization [req-19810505-5e6e-473e-8e92-df86e9899385 req-4e5703af-f218-4423-a34f-cb418591a989 tempest-ServersAdminNegativeTestJSON-1695298807 tempest-ServersAdminNegativeTestJSON-1695298807-project-member] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 607.037413] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 607.037728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.037849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.037937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.040806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.041057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.041398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.041398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.041483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.041514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.041625] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.227622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a487cd5-3889-4958-8d55-905893da1206 [ 607.227622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.227622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.227622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.227622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.227622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.227622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a487cd5-3889-4958-8d55-905893da1206 already deleted. [ 607.227622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a487cd5-3889-4958-8d55-905893da1206" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.327399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.327575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.327704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.327938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.328064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.328208] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be created. [ 607.376072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.376276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.376324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.376568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.376773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.392269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: UNINITIALIZED for 2s [ 607.477011] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.477336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.477766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.477900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.479150] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.479150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.479150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.479150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.479392] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.479646] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.479888] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.479971] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.480252] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.480436] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.480908] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.481057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.503806] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.504009] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.504162] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.504353] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.504692] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.504893] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.505081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.505469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.505633] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.544101] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.544281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.544353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.544588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.544706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.544940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.545075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.545132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.545375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.545475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.545576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a already deleted. [ 607.545659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.750105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.750105] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.750105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.750105] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.013337] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.013337] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b not found, creating... [ 608.013337] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.013337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.013799] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.013799] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.013799] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.013799] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.014180] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.014530] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b is going to be created. [ 608.037192] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.037393] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.037524] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.037823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.038534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.038534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.252401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.253032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.253032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.253032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.253239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.253239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.253388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.253500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.253568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.253676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.253819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.253913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.253974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.254273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.254273] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.254411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.254411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.254650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.254650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.254737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.254847] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.479043] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab778bff-9b46-425e-a4de-9e562059f1c8 req-e03682db-51f8-46f0-9909-2310cb37d2a9 tempest-VolumesAssistedSnapshotsTest-1186702850 tempest-VolumesAssistedSnapshotsTest-1186702850-project-member] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 608.479043] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 608.479043] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.479043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.481443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.481443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.481727] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.481727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.481847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.482539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.482539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.482539] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.758913] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 608.768076] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 608.768601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.774203] env[65119]: INFO networking_nsxv3.common.synchronization [req-19810505-5e6e-473e-8e92-df86e9899385 req-9835bc10-c1d4-41aa-b4f4-3d322071f163 service nova] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_rules [ 608.774416] env[65119]: INFO networking_nsxv3.common.synchronization [req-19810505-5e6e-473e-8e92-df86e9899385 req-9835bc10-c1d4-41aa-b4f4-3d322071f163 service nova] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 608.774549] env[65119]: INFO networking_nsxv3.common.synchronization [req-19810505-5e6e-473e-8e92-df86e9899385 req-9835bc10-c1d4-41aa-b4f4-3d322071f163 service nova] Enqueued Resource ID: 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b with Priority: HIGHEST for action port [ 608.775474] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_rules [ 608.775474] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 608.775474] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b with Priority: HIGHEST for action port [ 608.775636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.775780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.775780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.776424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.776542] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.777624] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.777624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.777767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.778620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.778620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.778620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.778620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.778620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.778620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.778620] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.782664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.782817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.782887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.785622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.785622] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.785622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.785622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.785622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.785622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.785622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.785983] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.785983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.785983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.788066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.788066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.788066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.788066] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be created. [ 608.866749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.866749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.866749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.867014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.867014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.881635] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 608.987629] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.987629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.987629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.987629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.987629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.987986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.988048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.988187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.989097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.989463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.989535] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 already deleted. [ 608.989631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.139751] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.140053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-873" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.140239] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-873" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.140670] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-873" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.140955] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.142042] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.142042] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.142355] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.143210] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.143210] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.143210] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.143831] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.143831] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.143944] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.144037] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.144547] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.169269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.169387] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.169477] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.170176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-873" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170176] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.171226] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.171226] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.171226] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.171226] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1e8f22a-f40b-47ea-95ad-94fc3b198bb7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.285049] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.286529] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.286529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.291273] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b with status ACTIVE [ 609.291412] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.291604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.291688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.291882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.291947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.292123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.292233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.292310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.292774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.292774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.292774] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.292989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.292989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.293092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.293155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.293252] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b is going to be updated. [ 609.328151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.328151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.328151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.328448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.328448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.328542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5fe736-2ae6-4e6f-83bb-bb727ff2b38b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.383242] env[65119]: INFO networking_nsxv3.common.synchronization [None req-cc8319e7-ad0f-4484-b1d4-40d42b43125a None None] Enqueued Resource ID: c65f31d3-7c17-4095-9876-d9228e922463 with Priority: HIGHEST for action port [ 609.383242] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65f31d3-7c17-4095-9876-d9228e922463 with Priority: HIGHEST for action port [ 609.383804] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c65f31d3-7c17-4095-9876-d9228e922463 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.384262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c65f31d3-7c17-4095-9876-d9228e922463" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.386382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c65f31d3-7c17-4095-9876-d9228e922463" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.386382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c65f31d3-7c17-4095-9876-d9228e922463" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.386382] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c65f31d3-7c17-4095-9876-d9228e922463',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.407801] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.410032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.410032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.410032] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.676771] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.676771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 not found, creating... [ 609.676771] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.676771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.677332] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.677332] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.677332] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.677618] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.678528] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.678528] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 is going to be created. [ 609.702238] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.702461] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.702583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.703025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.703159] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.703400] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.787402] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.888136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c65f31d3-7c17-4095-9876-d9228e922463 [ 609.888448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.888663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.888767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.889089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.889225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.889360] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c65f31d3-7c17-4095-9876-d9228e922463 already deleted. [ 609.889479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c65f31d3-7c17-4095-9876-d9228e922463" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.913135] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.289864] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.289864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.289864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.291044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.291044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.291044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be created. [ 610.317282] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.317564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.317564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.317772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.317925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.329386] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: UNINITIALIZED for 2s [ 610.414735] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab778bff-9b46-425e-a4de-9e562059f1c8 req-424f9e97-52e5-4bec-983d-db79386b367a service nova] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 610.415223] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab778bff-9b46-425e-a4de-9e562059f1c8 req-424f9e97-52e5-4bec-983d-db79386b367a service nova] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 610.415223] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab778bff-9b46-425e-a4de-9e562059f1c8 req-424f9e97-52e5-4bec-983d-db79386b367a service nova] Enqueued Resource ID: b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 with Priority: HIGHEST for action port [ 610.416538] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cec5d72a-5222-4ea2-bb61-5a248eace68e: rpc.has_security_group_logging(os_id): False [ 610.417879] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_rules [ 610.418047] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 610.418152] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 with Priority: HIGHEST for action port [ 610.418485] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.419152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.419256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.419440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.419534] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.425305] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.425433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.425535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.425692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.425884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.426016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.426095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.426243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.426327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.426489] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.428387] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.428545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.428627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.429094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.429094] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1e8f22a-f40b-47ea-95ad-94fc3b198bb7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.450850] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.451077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.451160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.451382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.451618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.451919] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.452117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.452215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.452419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.452542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.452694] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be created. [ 610.519971] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.520202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.520202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.520412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.520601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.531147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 610.760323] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a65dba06-91ba-4429-99ba-2c9d99c3e12f None None] Enqueued Resource ID: 7b6e4af9-abb6-452c-a0b1-58b209a1f868 with Priority: HIGHEST for action port [ 610.760925] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b6e4af9-abb6-452c-a0b1-58b209a1f868 with Priority: HIGHEST for action port [ 610.762218] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b6e4af9-abb6-452c-a0b1-58b209a1f868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.762218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b6e4af9-abb6-452c-a0b1-58b209a1f868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.762218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b6e4af9-abb6-452c-a0b1-58b209a1f868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.762218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b6e4af9-abb6-452c-a0b1-58b209a1f868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.762218] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b6e4af9-abb6-452c-a0b1-58b209a1f868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.897614] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 610.898027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.932367] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.932562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.936232] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 with status ACTIVE [ 610.936776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.936935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.936935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.937098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.937192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.937753] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.938398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.938653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.938794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.938934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.939099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.939099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.939271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.939324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.939399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1e8f22a-f40b-47ea-95ad-94fc3b198bb7 is going to be updated. [ 610.940780] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.964759] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.964759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.964759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.964997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.964997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.965219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1e8f22a-f40b-47ea-95ad-94fc3b198bb7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.265312] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b6e4af9-abb6-452c-a0b1-58b209a1f868 [ 611.265570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.265761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.265928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.267482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.269174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.269763] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b6e4af9-abb6-452c-a0b1-58b209a1f868 already deleted. [ 611.269763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b6e4af9-abb6-452c-a0b1-58b209a1f868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.443920] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.946238] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.946399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.947314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.947314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.947314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.947314] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 is going to be created. [ 611.980624] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.980624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.980805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.981323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.981323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.994765] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: UNINITIALIZED for 2s [ 612.342515] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 612.343331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.345871] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.345871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.345871] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.555663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 612.556122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.811807] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a4d15665-6a77-4db5-ac0e-ec3f74083376 None None] Enqueued Resource ID: fee8755a-1b59-4552-882c-01b34474b37a with Priority: HIGHEST for action port [ 612.812413] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee8755a-1b59-4552-882c-01b34474b37a with Priority: HIGHEST for action port [ 612.812781] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fee8755a-1b59-4552-882c-01b34474b37a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.812944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fee8755a-1b59-4552-882c-01b34474b37a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.813645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fee8755a-1b59-4552-882c-01b34474b37a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.813645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fee8755a-1b59-4552-882c-01b34474b37a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.813645] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fee8755a-1b59-4552-882c-01b34474b37a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.851423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.851423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.851423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.851423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.852631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.852631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.852631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.853092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.854162] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.258706] env[65119]: INFO networking_nsxv3.common.synchronization [req-3340505b-96b8-4695-a846-e4eeb641a8b9 req-5425453a-ed60-493d-87bd-2df9a18284d2 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 613.261744] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 613.262178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.262311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.262418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.262715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.262936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.264713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.264713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.264843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.265456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.265589] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.316266] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fee8755a-1b59-4552-882c-01b34474b37a [ 613.316436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.316697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.316697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.316872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.316996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.317166] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fee8755a-1b59-4552-882c-01b34474b37a already deleted. [ 613.317166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fee8755a-1b59-4552-882c-01b34474b37a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.358365] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c59b58cb-0641-49be-856b-56dc606d886a: rpc.has_security_group_logging(os_id): False [ 613.377521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.377696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.377761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.377979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.378080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.378278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.378399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.378454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.378589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.378670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.378862] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.379262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.379262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.379262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.379262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.379453] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.379510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.379577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.379959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.379959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.379959] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be created. [ 613.479458] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.479679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.479729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.480154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.480154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.497026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 613.770126] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.770792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.772311] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.772311] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f already deleted. [ 613.772311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.976476] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.976860] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-381" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.977074] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-381" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.977504] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-381" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.979663] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.979977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.980900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.980900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.981269] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.981540] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.981769] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.981991] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.982384] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.982925] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.983161] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.983433] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.006264] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: SUCCESS [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.008220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.008220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.008220] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.009859] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.009859] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.012446] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.012446] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-381" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.012446] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-26d06485-a0a9-4364-8300-c7d883ff2b16 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.012446] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.012446] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.012446] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.012446] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d06485-a0a9-4364-8300-c7d883ff2b16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.513798] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.514876] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.515068] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.515186] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.515451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.515594] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.515741] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 26d06485-a0a9-4364-8300-c7d883ff2b16 not found, creating... [ 614.516111] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.516303] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.516398] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.517192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.517192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.517192] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.517192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.517384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.517642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.517704] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.517891] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 is going to be created. [ 614.537895] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.538153] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.538272] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.538661] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.538926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.539170] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.019886] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8715bb3f-fafd-4a93-8c90-1ffdefe06065: rpc.has_security_group_logging(os_id): False [ 615.042414] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.042414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.042608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.042736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.042827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.043434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.043434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.043434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.043630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.043630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.043696] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 is going to be created. [ 615.115588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.115588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.115588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.115918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.115918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.132478] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: IN_PROGRESS for 2s [ 615.344012] env[65119]: INFO networking_nsxv3.common.synchronization [req-3340505b-96b8-4695-a846-e4eeb641a8b9 req-4b5fd3c4-e330-4d17-bb1d-830d613b04fc service nova] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 615.344111] env[65119]: INFO networking_nsxv3.common.synchronization [req-3340505b-96b8-4695-a846-e4eeb641a8b9 req-4b5fd3c4-e330-4d17-bb1d-830d613b04fc service nova] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 615.344406] env[65119]: INFO networking_nsxv3.common.synchronization [req-3340505b-96b8-4695-a846-e4eeb641a8b9 req-4b5fd3c4-e330-4d17-bb1d-830d613b04fc service nova] Enqueued Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 615.345097] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 615.345097] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 615.348924] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 615.348924] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.348924] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.348924] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.348924] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.348924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.349895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.349895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.349895] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.352322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d06485-a0a9-4364-8300-c7d883ff2b16 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.352322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.352322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.352322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.352322] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d06485-a0a9-4364-8300-c7d883ff2b16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.515676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 615.515823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.853598] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.853725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.853952] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.856349] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d06485-a0a9-4364-8300-c7d883ff2b16 with status ACTIVE [ 615.856600] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.856730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.856803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.857016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.857101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.857275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.857375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.857435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.857591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.857665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.857858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.857944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.858009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.858154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.858226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.858308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 is going to be updated. [ 615.893073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.893291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.893351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.893544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.893755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.893957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.357555] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.862306] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.862558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.862558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.862752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.862847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.862949] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be created. [ 616.892391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.892563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.892631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.892822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.893014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.904492] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: UNINITIALIZED for 2s [ 617.148228] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: SUCCESS [ 617.148475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.693874] env[65119]: INFO networking_nsxv3.common.synchronization [None req-046ad19c-0c79-4169-8065-15c43212f7f4 None None] Enqueued Resource ID: 361f6373-9d0b-4989-b688-687d0c938856 with Priority: HIGHEST for action port [ 617.694693] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f6373-9d0b-4989-b688-687d0c938856 with Priority: HIGHEST for action port [ 617.695675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-361f6373-9d0b-4989-b688-687d0c938856 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.697080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-361f6373-9d0b-4989-b688-687d0c938856" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.697080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-361f6373-9d0b-4989-b688-687d0c938856" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.698197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-361f6373-9d0b-4989-b688-687d0c938856" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.698197] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361f6373-9d0b-4989-b688-687d0c938856',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.200227] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 361f6373-9d0b-4989-b688-687d0c938856 [ 618.200787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.200971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.201079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.201363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.201484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.201629] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:361f6373-9d0b-4989-b688-687d0c938856 already deleted. [ 618.201736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-361f6373-9d0b-4989-b688-687d0c938856" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.917195] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 618.917647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.917647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.917935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.917989] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.918120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.918181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.920081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.920081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.920081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.920081] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.160059] env[65119]: INFO networking_nsxv3.common.synchronization [None req-066c0d6e-8d31-4a5f-b06e-5e728a506ac6 None None] Enqueued Resource ID: 016b2284-f7b3-4690-8339-1c90d9bb0e8e with Priority: HIGHEST for action port [ 619.160059] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 016b2284-f7b3-4690-8339-1c90d9bb0e8e with Priority: HIGHEST for action port [ 619.160279] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-016b2284-f7b3-4690-8339-1c90d9bb0e8e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.160279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-016b2284-f7b3-4690-8339-1c90d9bb0e8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.160279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-016b2284-f7b3-4690-8339-1c90d9bb0e8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.160662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-016b2284-f7b3-4690-8339-1c90d9bb0e8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.160760] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('016b2284-f7b3-4690-8339-1c90d9bb0e8e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.423022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.423022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.423022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.423022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.423022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.427103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.427103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.427655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.427655] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.427655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.427655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.427869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.427900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.428767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.428767] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.663107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 016b2284-f7b3-4690-8339-1c90d9bb0e8e [ 619.663393] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.663532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.663601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.663825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.663917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.664017] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:016b2284-f7b3-4690-8339-1c90d9bb0e8e already deleted. [ 619.664107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-016b2284-f7b3-4690-8339-1c90d9bb0e8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.932938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81cbcc67-f57a-4093-8432-a803e36e5a2f: rpc.has_security_group_logging(os_id): False [ 619.955733] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.955733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.955733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.955733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.955733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.956400] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.956400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.956400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.956680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.956680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.956857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.956921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.956958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.958100] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.958100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.958100] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be created. [ 620.048619] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.048835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.049044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.049295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.049590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.069937] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 620.198346] env[65119]: INFO networking_nsxv3.common.synchronization [None req-60d44702-4617-4499-9603-e9ada3b5e574 None None] Enqueued Resource ID: 646d3b45-408f-49f2-9ef9-5d48ccd4bba6 with Priority: HIGHEST for action port [ 620.198993] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646d3b45-408f-49f2-9ef9-5d48ccd4bba6 with Priority: HIGHEST for action port [ 620.199497] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-646d3b45-408f-49f2-9ef9-5d48ccd4bba6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.199778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-646d3b45-408f-49f2-9ef9-5d48ccd4bba6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.199963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-646d3b45-408f-49f2-9ef9-5d48ccd4bba6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.200331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-646d3b45-408f-49f2-9ef9-5d48ccd4bba6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.200519] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('646d3b45-408f-49f2-9ef9-5d48ccd4bba6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.305220] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 620.305220] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 620.305513] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 620.308021] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 620.308021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.308021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.308021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.308021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.308581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.308688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.308688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.308989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.309264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.309398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.309495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.309655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.309861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.309960] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.371747] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 620.371747] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 620.371747] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_rules [ 620.371747] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 620.371747] env[65119]: INFO networking_nsxv3.common.synchronization [req-3dbae3a0-8182-42f4-9fc6-e6fb9d969b05 req-e137f91a-1ed4-4b70-ab32-faf38aa90968 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 620.372015] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 620.372601] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_rules [ 620.372601] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 620.372601] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 620.372601] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 620.372751] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.372805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.372977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.373286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.373286] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.374741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.374741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.374741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.374741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.374741] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.375464] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.375600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.375661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.375801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.375878] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.376874] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.376874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.377805] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.377805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.704415] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 646d3b45-408f-49f2-9ef9-5d48ccd4bba6 [ 620.704677] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.704818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.704888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.705129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.705222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.705318] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:646d3b45-408f-49f2-9ef9-5d48ccd4bba6 already deleted. [ 620.705399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-646d3b45-408f-49f2-9ef9-5d48ccd4bba6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.813849] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.815727] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.878779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.878779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.878779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with status ACTIVE [ 620.878779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.878779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.879147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.879147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.879329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.879987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.879987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.879987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.879987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.879987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.879987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.880324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.880324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.880752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.880752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.880752] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 is going to be updated. [ 620.882172] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.882172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.909339] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.909339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.909339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.909339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.909339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.909339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.315521] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.316986] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.818712] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.818970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.818970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.819402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.819402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.819402] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 621.820926] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.821097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.821161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.821335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.821424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.821528] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be created. [ 621.891382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.891804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.891804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.892071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.892613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.896174] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.896174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.896174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.896649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.897573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.921382] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 621.924348] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: UNINITIALIZED for 2s [ 622.085948] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 622.086223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.327207] env[65119]: INFO networking_nsxv3.common.synchronization [req-f3f35362-2d97-498a-bdb5-2161b2b05a88 req-dbfdd040-faf1-4d2e-873e-f546d515e280 tempest-ImagesNegativeTestJSON-1950409452 tempest-ImagesNegativeTestJSON-1950409452-project-member] Enqueued Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 622.328037] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 622.329864] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.330037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.330443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.330510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.330701] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.332703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.332826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.333139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.333266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.333391] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.493097] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6ce6fab4-9a68-494f-bc59-a910af08dcf6 None None] Enqueued Resource ID: 0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88 with Priority: HIGHEST for action port [ 622.493651] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88 with Priority: HIGHEST for action port [ 622.494052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.494317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.494317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.494578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.494685] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.838741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.838947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.839034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.839308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.839439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.839699] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.839827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.839919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.840154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.840236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.840325] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a already deleted. [ 622.840409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.844042] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.844042] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.844352] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.844451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.844632] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.844800] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.844898] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.845127] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.845264] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.845463] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.845584] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.847057] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.847057] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.847057] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.847242] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.847321] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.871708] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.871891] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.872037] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.872215] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.872561] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-0a659861-fe73-435c-918e-c10c3110eeee taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.872741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.872855] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.874522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.874522] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a659861-fe73-435c-918e-c10c3110eeee',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.997918] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88 [ 622.998918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.999107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.999211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.999499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.999621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.999751] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88 already deleted. [ 622.999867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bbf3b70-cc66-4cbb-80a4-b1a9aa2b9d88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.376740] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.377110] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.377228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.377636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.377798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.377949] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 0a659861-fe73-435c-918e-c10c3110eeee not found, creating... [ 623.378253] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.378407] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.378518] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.378752] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.378894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.379247] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.379409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.379537] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.379744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.379872] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.380012] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 0a659861-fe73-435c-918e-c10c3110eeee is going to be created. [ 623.401291] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.401510] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.401611] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.401890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.402219] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.402547] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.943439] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 623.943803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.944036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.944291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.944672] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.944672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.944814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.945476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.945620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.945748] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.947457] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 623.947630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.947867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.948050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.948225] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.948334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.948392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.948594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.948698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.949123] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.124941] env[65119]: INFO networking_nsxv3.common.synchronization [req-f3f35362-2d97-498a-bdb5-2161b2b05a88 req-f152c1d2-1607-4c8b-9aa7-fa51ed527f6d service nova] Enqueued Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_rules [ 624.125274] env[65119]: INFO networking_nsxv3.common.synchronization [req-f3f35362-2d97-498a-bdb5-2161b2b05a88 req-f152c1d2-1607-4c8b-9aa7-fa51ed527f6d service nova] Enqueued Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 624.125543] env[65119]: INFO networking_nsxv3.common.synchronization [req-f3f35362-2d97-498a-bdb5-2161b2b05a88 req-f152c1d2-1607-4c8b-9aa7-fa51ed527f6d service nova] Enqueued Resource ID: 0a659861-fe73-435c-918e-c10c3110eeee with Priority: HIGHEST for action port [ 624.126395] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_rules [ 624.126656] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 624.126884] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a659861-fe73-435c-918e-c10c3110eeee with Priority: HIGHEST for action port [ 624.127273] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.127678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.127853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.128262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.128471] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.129721] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.129962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.130197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.130461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132836] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.132836] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.132836] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a659861-fe73-435c-918e-c10c3110eeee taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.132836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132836] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a659861-fe73-435c-918e-c10c3110eeee',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.339069] env[65119]: INFO networking_nsxv3.common.synchronization [req-a39ede9e-279f-4b5c-8611-2e5f90404387 req-6c3f7bef-d502-4d72-ae12-a32f0b5b31aa tempest-DeleteServersAdminTestJSON-1598523343 tempest-DeleteServersAdminTestJSON-1598523343-project-admin] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 624.339637] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 624.339953] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.340130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.340174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.340351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.340506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.340606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.340670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.340819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.340905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.340999] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.450897] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.452285] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.638089] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.638244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.638463] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.639485] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a659861-fe73-435c-918e-c10c3110eeee with status ACTIVE [ 624.639753] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.639865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.639865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.640111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.640178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.640357] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.640476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.640531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.640699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.640783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.641020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.641516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.641592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.641859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.641859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.642021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a659861-fe73-435c-918e-c10c3110eeee is going to be updated. [ 624.679427] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.679754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.679924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.680305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.680557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.680856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a659861-fe73-435c-918e-c10c3110eeee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.844332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.844332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.844332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.844332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.844332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.844332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.845148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.845148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.845350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.845350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.845467] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be updated. [ 624.954716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.958332] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.981226] env[65119]: INFO networking_nsxv3.common.synchronization [req-30028355-5eea-46a8-a0ae-076024ebcf72 req-73eabe8d-cefc-42b2-b2f5-206022afe377 tempest-ServerDiagnosticsTest-1101170317 tempest-ServerDiagnosticsTest-1101170317-project-member] Enqueued Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 624.981643] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c347da-631c-445c-b2e6-004a6894e069 with Priority: HIGHEST for action security_group_members [ 624.982473] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7c347da-631c-445c-b2e6-004a6894e069 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.982830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.984043] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.984043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.984043] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7c347da-631c-445c-b2e6-004a6894e069',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.992991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.992991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.992991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.992991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.992991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.009971] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 625.015992] env[65119]: INFO networking_nsxv3.common.synchronization [req-3c196efa-44f8-4766-a50e-7035a88f5a06 req-e2299530-9009-4644-aac2-859bdc8a0ff9 tempest-ServerDiagnosticsNegativeTest-856482237 tempest-ServerDiagnosticsNegativeTest-856482237-project-member] Enqueued Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 625.018454] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 625.019046] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.019228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.019415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.019573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.019746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.019852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.019927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.020075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.020172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.020251] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.145108] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.461626] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.462106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.462106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.462281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.462281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.462475] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 625.464111] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.464336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.464336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.465605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.465605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.465605] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 625.487304] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.487518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.487688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.488157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.488237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.488491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.488630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.488751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.488994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.489089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.489196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7c347da-631c-445c-b2e6-004a6894e069 is going to be updated. [ 625.503685] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.504035] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.504189] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.504544] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.504881] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.505060] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.505174] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.505413] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.505582] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.505848] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.506020] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.506135] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.506243] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.506413] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.506528] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.506888] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.522679] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.522967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.523075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.523338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.523430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.523719] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.523866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.523927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.524131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.524210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.524298] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 already deleted. [ 625.524410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.561150] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.561150] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.561150] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.561150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.562081] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-286f25f0-1e1d-4c83-9037-7418b8821e93 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.562293] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.562410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.562746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.562899] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286f25f0-1e1d-4c83-9037-7418b8821e93',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.566670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.567357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.567357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.567357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.567357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.570670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.570670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.570670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.570927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.570927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.578283] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 625.579471] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 625.581947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.581947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.582109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.582289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.582399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.591680] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: IN_PROGRESS for 2s [ 625.651027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.651027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.651027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.651027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.651027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.651027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a is going to be created. [ 625.679404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.679701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.679701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.679952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.680135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.691322] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: UNINITIALIZED for 2s [ 626.066605] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.066931] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.067096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.067478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.067633] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.067781] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 286f25f0-1e1d-4c83-9037-7418b8821e93 not found, creating... [ 626.068063] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.068216] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.068357] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.068589] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.068728] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.069020] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.069189] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.069298] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.069539] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.070127] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.070127] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 286f25f0-1e1d-4c83-9037-7418b8821e93 is going to be created. [ 626.126242] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.126511] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.126683] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.126972] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.127215] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.127478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.770493] env[65119]: INFO networking_nsxv3.common.synchronization [req-3c196efa-44f8-4766-a50e-7035a88f5a06 req-b85b1003-d928-4657-aade-fe2f191f4c98 service nova] Enqueued Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_rules [ 626.770854] env[65119]: INFO networking_nsxv3.common.synchronization [req-3c196efa-44f8-4766-a50e-7035a88f5a06 req-b85b1003-d928-4657-aade-fe2f191f4c98 service nova] Enqueued Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 626.770979] env[65119]: INFO networking_nsxv3.common.synchronization [req-3c196efa-44f8-4766-a50e-7035a88f5a06 req-b85b1003-d928-4657-aade-fe2f191f4c98 service nova] Enqueued Resource ID: 286f25f0-1e1d-4c83-9037-7418b8821e93 with Priority: HIGHEST for action port [ 626.771682] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_rules [ 626.771825] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 626.771916] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 286f25f0-1e1d-4c83-9037-7418b8821e93 with Priority: HIGHEST for action port [ 626.772250] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.772380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.772455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.772746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.772844] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.773847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.773964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.774043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.774231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.774375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.774499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.774588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.774739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.774827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.774934] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.776123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-286f25f0-1e1d-4c83-9037-7418b8821e93 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.776261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.776305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.777218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.777218] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286f25f0-1e1d-4c83-9037-7418b8821e93',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.022624] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 627.022624] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 deletion is rescheduled due to dependency. [ 627.022624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.190877] env[65119]: INFO networking_nsxv3.common.synchronization [req-4304ef9c-3bae-4215-9a19-fd24aea2bd9b req-52967f22-2918-4134-af99-00db3bd18707 tempest-InstanceActionsV221TestJSON-531095894 tempest-InstanceActionsV221TestJSON-531095894-project-member] Enqueued Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 627.191473] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 627.191779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.191906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.191977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.192343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.192562] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.192671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.192749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.192934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.193051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.193153] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.281712] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.283685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.283685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.283913] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 286f25f0-1e1d-4c83-9037-7418b8821e93 with status ACTIVE [ 627.285034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.285034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.285034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.285652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.285652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.286037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.286130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.286201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.286488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.287651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.287651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 286f25f0-1e1d-4c83-9037-7418b8821e93 is going to be updated. [ 627.313474] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.316547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.316547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.316547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.316547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.316547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-286f25f0-1e1d-4c83-9037-7418b8821e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.473132] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0ab35cd3-57a3-4352-81d2-a68d60935eb6 None None] Enqueued Resource ID: bc96094f-41a2-4691-9e8e-a2825a2b92a4 with Priority: HIGHEST for action port [ 627.473674] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc96094f-41a2-4691-9e8e-a2825a2b92a4 with Priority: HIGHEST for action port [ 627.473991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc96094f-41a2-4691-9e8e-a2825a2b92a4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.474129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc96094f-41a2-4691-9e8e-a2825a2b92a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.474193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc96094f-41a2-4691-9e8e-a2825a2b92a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.474498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc96094f-41a2-4691-9e8e-a2825a2b92a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.474608] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc96094f-41a2-4691-9e8e-a2825a2b92a4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.595028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 627.595028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.595028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.595028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.595330] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.595330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.595330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.595458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.595571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.596226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.596387] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.603432] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.603432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.603432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.603432] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.612807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7c347da-631c-445c-b2e6-004a6894e069 in Status: SUCCESS [ 627.612807] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7c347da-631c-445c-b2e6-004a6894e069 deletion is rescheduled due to dependency. [ 627.612807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7c347da-631c-445c-b2e6-004a6894e069" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.658151] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-518 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.658350] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-518" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.658469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-518" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.658869] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-518" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.659209] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.659412] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.659563] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.659919] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.660141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.660404] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.660549] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.660683] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.660820] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.660955] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.661094] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.661252] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.686830] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.687136] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.687376] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.687635] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-518" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.687963] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-ac9f99c2-73c4-4cde-93b6-0bf177401439 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.688252] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.688342] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.688698] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.688874] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac9f99c2-73c4-4cde-93b6-0bf177401439',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.695397] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.696015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.696111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.696334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.696430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.696687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.696810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.696874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.697051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.697131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.697225] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f already deleted. [ 627.697306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.705518] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: SUCCESS [ 627.705733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.706257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.706486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.706751] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.706881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.706937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.707131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.707215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.707300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.707391] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.793168] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.977492] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc96094f-41a2-4691-9e8e-a2825a2b92a4 [ 627.977754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.977932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.978015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.978180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.978263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.978357] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc96094f-41a2-4691-9e8e-a2825a2b92a4 already deleted. [ 627.978431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc96094f-41a2-4691-9e8e-a2825a2b92a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.082215] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 628.082397] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 628.082514] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 628.083545] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 628.083545] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 628.083761] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 628.084154] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.084154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.084154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.084460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.084885] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.085009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.085080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.085388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.085388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.085484] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.086352] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.086491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.086526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.086779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.086931] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.086931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.087209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.087270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.087351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.087443] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.088448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.088561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.089062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.089062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.089062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.089062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.089062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.089328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.089328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.089698] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.104096] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.110325] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.110480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.138274] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 628.138437] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_rules [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_rules [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [req-596aa8f5-e1d9-4bce-99e1-7a2f004d4c76 req-cfa37341-6488-4c10-863d-b736449f9b0f tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 628.139687] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 628.139985] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_rules [ 628.140031] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 628.140196] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with Priority: HIGHEST for action port [ 628.140316] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_rules [ 628.140446] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 628.140614] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 628.141845] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.141845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.141845] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.141845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.141845] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.142099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.142178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.142311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.142395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.142699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.142745] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.146177] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.146177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.146177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.146177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.146177] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.146177] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.146177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.146177] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.146177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.192423] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.196020] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port ac9f99c2-73c4-4cde-93b6-0bf177401439 not found, creating... [ 628.196020] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.196020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.196478] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.196478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.196908] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: ac9f99c2-73c4-4cde-93b6-0bf177401439 is going to be created. [ 628.214032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.214032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.214032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.214032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.214032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.214699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.214699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.214699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.214699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.214699] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.227529] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.227794] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228122] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.228270] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.228548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.228740] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.298183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.298183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.298183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.298183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.298183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.298183] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 is going to be created. [ 628.359057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.359057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.359057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.359057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.359057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.375185] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: UNINITIALIZED for 2s [ 628.591732] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.593575] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.594820] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.606445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f16dbf-b372-4ba6-94a5-e3bf17f87f96: rpc.has_security_group_logging(os_id): False [ 628.625798] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.625949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.626013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.626209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.626301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.626533] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.626616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.626742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.626935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.626996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.627065] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be created. [ 628.646550] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 with status ACTIVE [ 628.646895] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.647052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.647124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.647375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.647465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.648406] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.648406] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.648406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.649044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.649044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.649044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5 is going to be updated. [ 628.649944] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.650117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.670917] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.671185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.671185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.671272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.671538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.671628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa3fc20-c2e6-46a6-bd02-6da30de1c4b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.698734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.698940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.698989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.699196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.699371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.716515] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 628.716831] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcf37b8c-257f-4c76-a225-26bb55a61d9a: rpc.has_security_group_logging(os_id): False [ 628.739588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.739588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.739588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.739588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.740462] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.740462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.740462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.740462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.740462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.740462] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a is going to be created. [ 628.913360] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.913360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.913360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.913360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.913360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.928921] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: IN_PROGRESS for 2s [ 628.945894] env[65119]: INFO networking_nsxv3.common.synchronization [req-4304ef9c-3bae-4215-9a19-fd24aea2bd9b req-15463273-0a87-4631-81d0-eac02241e0e9 service nova] Enqueued Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_rules [ 628.949298] env[65119]: INFO networking_nsxv3.common.synchronization [req-4304ef9c-3bae-4215-9a19-fd24aea2bd9b req-15463273-0a87-4631-81d0-eac02241e0e9 service nova] Enqueued Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 628.949298] env[65119]: INFO networking_nsxv3.common.synchronization [req-4304ef9c-3bae-4215-9a19-fd24aea2bd9b req-15463273-0a87-4631-81d0-eac02241e0e9 service nova] Enqueued Resource ID: ac9f99c2-73c4-4cde-93b6-0bf177401439 with Priority: HIGHEST for action port [ 628.949626] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_rules [ 628.950390] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 628.950390] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9f99c2-73c4-4cde-93b6-0bf177401439 with Priority: HIGHEST for action port [ 628.950390] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.951051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.951051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.951051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.951051] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.959394] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.959394] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.959394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.959394] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.963285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac9f99c2-73c4-4cde-93b6-0bf177401439 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.963531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.963612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.963896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.964547] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac9f99c2-73c4-4cde-93b6-0bf177401439',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.094269] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.095518] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.097272] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.188430] env[65119]: INFO networking_nsxv3.common.synchronization [req-0ef6d81d-72cd-4dd3-89de-667d3358aa4b req-80d505a4-a2e1-4642-a426-c1f8d38f83e1 tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 629.189056] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 629.189328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df211d86-e270-49cf-b482-a62ee9e29fc8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.189456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.189522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.193837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.193947] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df211d86-e270-49cf-b482-a62ee9e29fc8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.457695] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.457695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.467028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.469779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac9f99c2-73c4-4cde-93b6-0bf177401439 with status ACTIVE [ 629.469987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.470139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.470206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.470411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.470495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.470674] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.470759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.470816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.470970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.471055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.471766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.471766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.471766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.471766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.471766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.471766] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac9f99c2-73c4-4cde-93b6-0bf177401439 is going to be updated. [ 629.510654] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac9f99c2-73c4-4cde-93b6-0bf177401439" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.598555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.598736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.598736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.598910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.599054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.599162] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 629.600992] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.601193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.601287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.601519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.601635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.601754] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 629.603102] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.603264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.603358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.603666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.603781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.603910] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a is going to be created. [ 629.643487] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.643487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.643487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.643834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.643919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.670107] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.670107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.670107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.670107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.670107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.673262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.673988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.674118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.674344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.674494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.678567] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: UNINITIALIZED for 2s [ 629.684302] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 629.685161] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 629.718839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.719645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.719645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.719645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.719645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.719645] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df211d86-e270-49cf-b482-a62ee9e29fc8 already deleted. [ 629.719645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.812697] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6c2b548d-847d-448c-a9ae-3343f659da46 None None] Enqueued Resource ID: 3776aa01-ef8e-4523-b30f-228b29af21de with Priority: HIGHEST for action port [ 629.812833] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3776aa01-ef8e-4523-b30f-228b29af21de with Priority: HIGHEST for action port [ 629.814233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-3776aa01-ef8e-4523-b30f-228b29af21de taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.814434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3776aa01-ef8e-4523-b30f-228b29af21de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.814505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3776aa01-ef8e-4523-b30f-228b29af21de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.814905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3776aa01-ef8e-4523-b30f-228b29af21de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.815012] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3776aa01-ef8e-4523-b30f-228b29af21de',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.970952] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.091611] env[65119]: INFO networking_nsxv3.common.synchronization [None req-07f9fb11-ac1f-46aa-9952-fd149578d905 None None] Enqueued Resource ID: 22d8fd61-9c70-4f44-b901-a2168097818d with Priority: HIGHEST for action port [ 630.092924] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d8fd61-9c70-4f44-b901-a2168097818d with Priority: HIGHEST for action port [ 630.093386] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-22d8fd61-9c70-4f44-b901-a2168097818d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.093603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22d8fd61-9c70-4f44-b901-a2168097818d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.093788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22d8fd61-9c70-4f44-b901-a2168097818d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.094056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22d8fd61-9c70-4f44-b901-a2168097818d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.094174] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22d8fd61-9c70-4f44-b901-a2168097818d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.317738] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3776aa01-ef8e-4523-b30f-228b29af21de [ 630.318622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.318622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.318622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.318622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.318622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.318622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3776aa01-ef8e-4523-b30f-228b29af21de already deleted. [ 630.319062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3776aa01-ef8e-4523-b30f-228b29af21de" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.386488] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: SUCCESS [ 630.386732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.386916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.387156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.387354] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.387497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.387569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.387722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.387865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.387937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.387994] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.474952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.475825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.475825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.475825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.475825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.475825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f is going to be created. [ 630.503033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.503033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.503033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.503033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.503033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.515685] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: UNINITIALIZED for 2s [ 630.598676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22d8fd61-9c70-4f44-b901-a2168097818d [ 630.598676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.598676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.598676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.598676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.598676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.598676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22d8fd61-9c70-4f44-b901-a2168097818d already deleted. [ 630.598676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22d8fd61-9c70-4f44-b901-a2168097818d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.731362] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 630.731362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.731362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.731584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.731636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.891953] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.891953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.891953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.892355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.893358] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.893828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.894690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.894994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.895194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.895595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.895871] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.895948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.895948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.896764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.897587] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.897901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.898212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.898284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.898525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.898766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.898835] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.942282] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: SUCCESS [ 630.942282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.237440] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.237440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.405712] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4720d561-4590-44ad-bcfd-bb12e7297342: rpc.has_security_group_logging(os_id): False [ 631.428467] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.429887] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.429887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.430549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.430843] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.430959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.431065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.431237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.431325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.431556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.431663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.431722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.431978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.431978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.432082] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 is going to be created. [ 631.502369] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.502521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.502590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.502814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.503020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.516903] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: IN_PROGRESS for 2s [ 631.693107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: SUCCESS [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.693107] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.693107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.693107] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.696206] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 631.696372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.696547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.696783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.696966] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.697112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.697188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.697444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.697566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.697727] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.704257] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 631.704804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.705446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.705871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.706426] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.706618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.706870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.710426] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.710426] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.710426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.710426] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.711973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.712454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.712626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.712746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.713104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.713229] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.196010] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.202084] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.215166] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 632.216610] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.237976] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.237976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.239184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.239184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.239184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.239184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.239184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.239184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.239551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.239551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.240161] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.240161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.240161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.240161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.240425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.240425] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.240509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.240996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.240996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.240996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.240996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 632.318613] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.318613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.318613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.318613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.318613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.340253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 632.526797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: SUCCESS [ 632.526797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.526797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.526797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.526797] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.526797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.527475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.527523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.527639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.528544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.528544] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.700473] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.704460] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.722590] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.037193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.037193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.037193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.037193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.037193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.037843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.037843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.037843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.037843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.037843] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.206738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.206738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.206738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.206738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.206738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.206738] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a is going to be updated. [ 633.210979] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.210979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.210979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.210979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.210979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.210979] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 633.227520] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.227520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.227520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.227520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.227520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.227520] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 633.252166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.252166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.252166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.252166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.252166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.253100] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.253284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.253369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.253609] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.253765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.266307] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: IN_PROGRESS for 2s [ 633.267542] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 633.274052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.274052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.274052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.274052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.274052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.288902] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 633.534477] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: SUCCESS [ 633.534941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.540503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e98c9fd-6d96-4213-8b32-1af5b432b21f: rpc.has_security_group_logging(os_id): False [ 633.563044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.563266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.563363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.563698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.563876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.564118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.564238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.564330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.564631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.564751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.565209] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.565365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.565474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.566539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.566539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.566539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.566539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.566539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.566821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.566854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.566995] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f is going to be created. [ 633.639708] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.639969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.640062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.640282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.640460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.655417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: IN_PROGRESS for 2s [ 634.347556] env[65119]: INFO networking_nsxv3.common.synchronization [req-c0bbf4af-46f8-492d-aff0-04939877bb03 req-cc62695c-feca-4ef2-9049-afa50cac9741 tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 634.348651] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 634.351186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df211d86-e270-49cf-b482-a62ee9e29fc8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.351531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.351858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.352229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.352430] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df211d86-e270-49cf-b482-a62ee9e29fc8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.367179] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 634.367179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.367179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.367179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.367179] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.439757] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c2b36d93-2023-4f95-8d16-1211ce4913a2 None None] Enqueued Resource ID: fd841e0b-b46c-4b70-b424-954face70e32 with Priority: HIGHEST for action port [ 634.440338] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd841e0b-b46c-4b70-b424-954face70e32 with Priority: HIGHEST for action port [ 634.440638] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd841e0b-b46c-4b70-b424-954face70e32 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.440999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd841e0b-b46c-4b70-b424-954face70e32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.441081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd841e0b-b46c-4b70-b424-954face70e32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.441343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd841e0b-b46c-4b70-b424-954face70e32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.441423] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd841e0b-b46c-4b70-b424-954face70e32',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.869476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.869620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.878310] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.878477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.878543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.878737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.878819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.878920] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df211d86-e270-49cf-b482-a62ee9e29fc8 already deleted. [ 634.879013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.944894] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd841e0b-b46c-4b70-b424-954face70e32 [ 634.946623] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.946623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.946623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.946623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.946623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.946623] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd841e0b-b46c-4b70-b424-954face70e32 already deleted. [ 634.946623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd841e0b-b46c-4b70-b424-954face70e32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.288539] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: SUCCESS [ 635.288707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.288707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.288976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.289210] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.289327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.289402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.289558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.289645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.289737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.289835] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.292262] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 635.292499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.294511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.297436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.297436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.297436] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.310663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 635.310663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.310663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.310663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.310663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.310663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.310663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.311061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.311061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.311061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.311230] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.674245] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: SUCCESS [ 635.674671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.797977] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.803038] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.814817] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.814817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.814817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.815170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.815170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.815251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.815346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.816532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.816532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.816532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.817468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.817468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.817468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.817604] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.301308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a: rpc.has_security_group_logging(os_id): False [ 636.307675] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f16dbf-b372-4ba6-94a5-e3bf17f87f96: rpc.has_security_group_logging(os_id): False [ 636.327035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.327035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.327035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.327035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a is going to be created. [ 636.327035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 636.334514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.336045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.336045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.336695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.336695] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 636.362030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.362030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.362030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.362030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.363804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.364050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.364374] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.364813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.364985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.365434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.365626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.367431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 636.384304] env[65119]: INFO networking_nsxv3.common.synchronization [None req-32b6ec97-f5c2-487f-a386-96d6bf477d8e None None] Enqueued Resource ID: d4b2d706-a816-4271-bee7-ab945d20d175 with Priority: HIGHEST for action port [ 636.384877] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b2d706-a816-4271-bee7-ab945d20d175 with Priority: HIGHEST for action port [ 636.385911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4b2d706-a816-4271-bee7-ab945d20d175 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.386131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4b2d706-a816-4271-bee7-ab945d20d175" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.386131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4b2d706-a816-4271-bee7-ab945d20d175" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.387346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4b2d706-a816-4271-bee7-ab945d20d175" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.387346] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4b2d706-a816-4271-bee7-ab945d20d175',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.442445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.443360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.443360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.443519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.443693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.447139] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.447332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.447392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.447559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.447759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.466423] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: IN_PROGRESS for 2s [ 636.469182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 636.469907] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.470101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.470197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.470421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.470561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.487083] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 636.892248] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4b2d706-a816-4271-bee7-ab945d20d175 [ 636.892248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.892587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.893561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.893911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.894135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.894294] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4b2d706-a816-4271-bee7-ab945d20d175 already deleted. [ 636.894443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4b2d706-a816-4271-bee7-ab945d20d175" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.061369] env[65119]: INFO networking_nsxv3.common.synchronization [None req-685d2f73-4ec7-44f0-aa1b-3af11892c757 None None] Enqueued Resource ID: d51f5100-34da-401f-ad08-aac8222aa4db with Priority: HIGHEST for action port [ 638.061369] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51f5100-34da-401f-ad08-aac8222aa4db with Priority: HIGHEST for action port [ 638.061369] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51f5100-34da-401f-ad08-aac8222aa4db taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.064212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51f5100-34da-401f-ad08-aac8222aa4db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.064680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51f5100-34da-401f-ad08-aac8222aa4db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.065238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51f5100-34da-401f-ad08-aac8222aa4db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.065470] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51f5100-34da-401f-ad08-aac8222aa4db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.199177] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1c88e7ee-9405-45e6-b3c2-4f0a2aecb679 None None] Enqueued Resource ID: b90ffe8b-12cc-421e-8ebc-360882955da1 with Priority: HIGHEST for action port [ 638.199177] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90ffe8b-12cc-421e-8ebc-360882955da1 with Priority: HIGHEST for action port [ 638.199177] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b90ffe8b-12cc-421e-8ebc-360882955da1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.199177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b90ffe8b-12cc-421e-8ebc-360882955da1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.199177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b90ffe8b-12cc-421e-8ebc-360882955da1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.199766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b90ffe8b-12cc-421e-8ebc-360882955da1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.200292] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b90ffe8b-12cc-421e-8ebc-360882955da1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.492274] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: SUCCESS [ 638.492274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.492274] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 638.492274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.512919] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 638.512919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.569152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d51f5100-34da-401f-ad08-aac8222aa4db [ 638.569456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.569736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.569868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.570100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.570204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.570300] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d51f5100-34da-401f-ad08-aac8222aa4db already deleted. [ 638.570439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51f5100-34da-401f-ad08-aac8222aa4db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.711309] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b90ffe8b-12cc-421e-8ebc-360882955da1 [ 638.711495] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.711639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.711708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.711918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.712049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.712152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b90ffe8b-12cc-421e-8ebc-360882955da1 already deleted. [ 638.712235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b90ffe8b-12cc-421e-8ebc-360882955da1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.738539] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2c3d85c-505a-4814-9f96-642f73867f4d req-95ef2648-4de3-44ee-b5df-7db05caaa3df tempest-ServersTestBootFromVolume-80384451 tempest-ServersTestBootFromVolume-80384451-project-member] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 639.739239] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 639.739596] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.739727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.739796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.741497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.741497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.742029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.784672] env[65119]: INFO networking_nsxv3.common.synchronization [None req-aed19bef-fa6d-4397-9153-ed03047e29ff None None] Enqueued Resource ID: b35ba05f-080f-4a93-b5d8-afa48caa75ce with Priority: HIGHEST for action port [ 639.785413] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b35ba05f-080f-4a93-b5d8-afa48caa75ce with Priority: HIGHEST for action port [ 639.785561] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b35ba05f-080f-4a93-b5d8-afa48caa75ce taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.785660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b35ba05f-080f-4a93-b5d8-afa48caa75ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.785731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b35ba05f-080f-4a93-b5d8-afa48caa75ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.786032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b35ba05f-080f-4a93-b5d8-afa48caa75ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.788209] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b35ba05f-080f-4a93-b5d8-afa48caa75ce',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.245050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.245507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.245629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.245977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.246150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.249122] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.249122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.249122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.249122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.249122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.249122] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 already deleted. [ 640.249122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.292424] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b35ba05f-080f-4a93-b5d8-afa48caa75ce [ 640.292424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.292424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.292424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.292424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.292424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.292424] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b35ba05f-080f-4a93-b5d8-afa48caa75ce already deleted. [ 640.292424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b35ba05f-080f-4a93-b5d8-afa48caa75ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.533625] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.534194] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-966" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.534194] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-966" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.534350] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-966" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.534608] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.534806] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.534932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.538139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.538458] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.538690] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.539392] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.539392] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.539392] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.539392] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.539716] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.539716] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.563587] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.563762] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.563898] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.564859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-966" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.564859] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.564859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.565087] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.565375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.565835] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcdf1f6-d0bd-4987-bc3a-174fd81de751',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.956048] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ea1d2a9c-5424-450e-a353-5f8fc6e756dd None None] Enqueued Resource ID: 43dfa8c6-13af-42e6-ac73-92d0a330520d with Priority: HIGHEST for action port [ 640.956643] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43dfa8c6-13af-42e6-ac73-92d0a330520d with Priority: HIGHEST for action port [ 640.956996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-43dfa8c6-13af-42e6-ac73-92d0a330520d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.957271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43dfa8c6-13af-42e6-ac73-92d0a330520d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.957339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43dfa8c6-13af-42e6-ac73-92d0a330520d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.957636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43dfa8c6-13af-42e6-ac73-92d0a330520d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.957734] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43dfa8c6-13af-42e6-ac73-92d0a330520d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.068350] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.068595] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.069166] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.069166] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.069451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.069451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port ddcdf1f6-d0bd-4987-bc3a-174fd81de751 not found, creating... [ 641.069773] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.069966] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.070061] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.070340] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.070625] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.070849] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.071068] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.071239] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.071618] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.071734] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.071890] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: ddcdf1f6-d0bd-4987-bc3a-174fd81de751 is going to be created. [ 641.109569] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.109805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.109930] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.110238] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.110513] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.110941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.460077] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43dfa8c6-13af-42e6-ac73-92d0a330520d [ 641.460336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.460509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.460615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.460894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.460995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.461103] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43dfa8c6-13af-42e6-ac73-92d0a330520d already deleted. [ 641.461186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43dfa8c6-13af-42e6-ac73-92d0a330520d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.871524] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2c3d85c-505a-4814-9f96-642f73867f4d req-bb2a5648-cb9d-468d-a7e6-c03ef2b59ba1 service nova] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 641.871882] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2c3d85c-505a-4814-9f96-642f73867f4d req-bb2a5648-cb9d-468d-a7e6-c03ef2b59ba1 service nova] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 641.872574] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2c3d85c-505a-4814-9f96-642f73867f4d req-bb2a5648-cb9d-468d-a7e6-c03ef2b59ba1 service nova] Enqueued Resource ID: ddcdf1f6-d0bd-4987-bc3a-174fd81de751 with Priority: HIGHEST for action port [ 641.873409] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_rules [ 641.873676] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 641.873870] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddcdf1f6-d0bd-4987-bc3a-174fd81de751 with Priority: HIGHEST for action port [ 641.874276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.874409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.874478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.874755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.874996] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.875990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.876839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.876951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.877323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.877531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.878108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.878208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.878426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.878540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.878665] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.880148] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.880772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.880932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.881450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.881672] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcdf1f6-d0bd-4987-bc3a-174fd81de751',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.283832] env[65119]: INFO networking_nsxv3.common.synchronization [req-021ceb2f-e57c-461a-80a8-0ebd263cdb53 req-ad5bd4d7-1638-444d-9328-5e40c35611ad tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 642.283832] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 642.283832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.284511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.285041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.285210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.285470] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.285952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.285952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.286905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.286905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.286905] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.384200] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.384200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.384200] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.385027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddcdf1f6-d0bd-4987-bc3a-174fd81de751 with status ACTIVE [ 642.385154] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.385791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.385791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.385791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.385791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.385993] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.385993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.386339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.386410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.386588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.386747] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.387154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.387267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.387458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.387570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.387670] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddcdf1f6-d0bd-4987-bc3a-174fd81de751 is going to be updated. [ 642.422992] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.423308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.423468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.423815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.423957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.424255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddcdf1f6-d0bd-4987-bc3a-174fd81de751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.789785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.789975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.790047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.790268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.790357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.790557] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.790659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.790743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.790927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.791029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.791114] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 already deleted. [ 642.791200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.892075] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.104611] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.104871] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.104938] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.105319] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.105615] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.105774] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.105890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.106141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.106294] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.106513] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.106632] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.106726] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.106894] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.107038] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.107150] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.107287] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.131643] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.131821] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.131897] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.132106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.132474] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-83f509e1-1e5a-4d71-87b0-698b7631d9e3 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.132645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.132761] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.133105] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.133392] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f509e1-1e5a-4d71-87b0-698b7631d9e3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.158353] env[65119]: INFO networking_nsxv3.common.synchronization [None req-2f6c5e54-e087-4389-a490-95a512e046d6 None None] Enqueued Resource ID: 24b8b7ec-8785-4235-b9b8-a4e1700bcc05 with Priority: HIGHEST for action port [ 643.160904] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24b8b7ec-8785-4235-b9b8-a4e1700bcc05 with Priority: HIGHEST for action port [ 643.160904] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-24b8b7ec-8785-4235-b9b8-a4e1700bcc05 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.160904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24b8b7ec-8785-4235-b9b8-a4e1700bcc05" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.160904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24b8b7ec-8785-4235-b9b8-a4e1700bcc05" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.160904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24b8b7ec-8785-4235-b9b8-a4e1700bcc05" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.161346] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24b8b7ec-8785-4235-b9b8-a4e1700bcc05',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.395388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.395854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.395854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.395947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.396196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.396196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 is going to be created. [ 643.431650] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.432575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.432575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.432575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.432575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.448831] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: UNINITIALIZED for 2s [ 643.637953] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.637953] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.637953] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.637953] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.637953] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.638331] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 83f509e1-1e5a-4d71-87b0-698b7631d9e3 not found, creating... [ 643.640263] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.640263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.640263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.640263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.640263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.640734] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.641052] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.641775] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.642342] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.642808] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.643224] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 83f509e1-1e5a-4d71-87b0-698b7631d9e3 is going to be created. [ 643.664761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24b8b7ec-8785-4235-b9b8-a4e1700bcc05 [ 643.664761] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.664761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.664761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.665693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.665854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.666023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24b8b7ec-8785-4235-b9b8-a4e1700bcc05 already deleted. [ 643.666070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24b8b7ec-8785-4235-b9b8-a4e1700bcc05" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.668690] env[65119]: INFO networking_nsxv3.common.synchronization [None req-769157b5-06d1-4838-9b5b-843b99c8ff1a None None] Enqueued Resource ID: 36a5d5d1-dfb6-451e-8003-fad3674badc2 with Priority: HIGHEST for action port [ 643.669332] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36a5d5d1-dfb6-451e-8003-fad3674badc2 with Priority: HIGHEST for action port [ 643.671264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-36a5d5d1-dfb6-451e-8003-fad3674badc2 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.671264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36a5d5d1-dfb6-451e-8003-fad3674badc2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.671264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36a5d5d1-dfb6-451e-8003-fad3674badc2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.671264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36a5d5d1-dfb6-451e-8003-fad3674badc2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.671264] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a5d5d1-dfb6-451e-8003-fad3674badc2',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.677846] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.681653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.681653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.681653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.681653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.681653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.185579] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36a5d5d1-dfb6-451e-8003-fad3674badc2 [ 644.186916] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.186916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.186916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.186916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.186916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.186916] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36a5d5d1-dfb6-451e-8003-fad3674badc2 already deleted. [ 644.186916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36a5d5d1-dfb6-451e-8003-fad3674badc2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.472094] env[65119]: INFO networking_nsxv3.common.synchronization [req-021ceb2f-e57c-461a-80a8-0ebd263cdb53 req-21625625-8039-4685-9961-d08c8343d21d service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 644.472449] env[65119]: INFO networking_nsxv3.common.synchronization [req-021ceb2f-e57c-461a-80a8-0ebd263cdb53 req-21625625-8039-4685-9961-d08c8343d21d service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 644.472449] env[65119]: INFO networking_nsxv3.common.synchronization [req-021ceb2f-e57c-461a-80a8-0ebd263cdb53 req-21625625-8039-4685-9961-d08c8343d21d service nova] Enqueued Resource ID: 83f509e1-1e5a-4d71-87b0-698b7631d9e3 with Priority: HIGHEST for action port [ 644.474051] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 644.475280] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 644.475432] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f509e1-1e5a-4d71-87b0-698b7631d9e3 with Priority: HIGHEST for action port [ 644.476188] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.477329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.478967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.478967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.478967] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.479413] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.479598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.479721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.480028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.480285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.480509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.480573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.480812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.480950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.485039] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.485039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-83f509e1-1e5a-4d71-87b0-698b7631d9e3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.485039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.485039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.485039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.485039] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f509e1-1e5a-4d71-87b0-698b7631d9e3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.698767] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e4357a82-8a0f-473e-bd1f-cec292fc943b None None] Enqueued Resource ID: 5b6c87b5-39ca-4ac9-91fa-11beb2de33da with Priority: HIGHEST for action port [ 644.699639] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b6c87b5-39ca-4ac9-91fa-11beb2de33da with Priority: HIGHEST for action port [ 644.700037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b6c87b5-39ca-4ac9-91fa-11beb2de33da taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.700037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b6c87b5-39ca-4ac9-91fa-11beb2de33da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.700037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b6c87b5-39ca-4ac9-91fa-11beb2de33da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.700956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b6c87b5-39ca-4ac9-91fa-11beb2de33da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.701084] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6c87b5-39ca-4ac9-91fa-11beb2de33da',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.897207] env[65119]: INFO networking_nsxv3.common.synchronization [req-79ebba3f-9509-4df6-b9f2-8849ddf7e2d2 req-51d278cb-149e-4e5f-88c8-1b82726566ac tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 644.897850] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 644.899946] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.899946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.899946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.901537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.901537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.901537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.901537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.901537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.901537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.901537] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.985783] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.990030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.990030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83f509e1-1e5a-4d71-87b0-698b7631d9e3 with status ACTIVE [ 644.990030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.990030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.990030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.990030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.991072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.991072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.991072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.991072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.991072] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83f509e1-1e5a-4d71-87b0-698b7631d9e3 is going to be updated. [ 645.016633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.017280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.017280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.017435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.018199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.018199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83f509e1-1e5a-4d71-87b0-698b7631d9e3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.205210] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b6c87b5-39ca-4ac9-91fa-11beb2de33da [ 645.205538] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.205911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.205911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.206144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.206619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.206619] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b6c87b5-39ca-4ac9-91fa-11beb2de33da already deleted. [ 645.206619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b6c87b5-39ca-4ac9-91fa-11beb2de33da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.406054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.406285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.406387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.406747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.406936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.411636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.411636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.411636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.411636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.411636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.411636] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a already deleted. [ 645.411636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.415748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.415947] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.416293] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.417489] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.417489] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.417489] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.417489] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.417916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.418121] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.418318] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.418431] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.418525] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.418633] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.418986] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.418986] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.418986] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.443941] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.443941] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.444127] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.444236] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.444579] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-97fa3aef-578e-415a-a2a6-0be2a36dda26 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.444745] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.444932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.445242] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.445334] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97fa3aef-578e-415a-a2a6-0be2a36dda26',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.460911] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: SUCCESS [ 645.461218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.461842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.461842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.461842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.462137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.462137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.462137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.462245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.462281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.462389] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.489876] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.951465] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.951935] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.951935] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.952204] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.952366] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.952519] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 97fa3aef-578e-415a-a2a6-0be2a36dda26 not found, creating... [ 645.952787] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.952941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.953064] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.953336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.953472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.953784] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.953986] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.956477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.956738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.957565] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.957804] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 97fa3aef-578e-415a-a2a6-0be2a36dda26 is going to be created. [ 645.966203] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.985026] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.985026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.985026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.985320] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.985577] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.985920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.993776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.994213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.994213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.994331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.994331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.994508] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 646.023727] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.023933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.023933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.024136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.024370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.036992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: UNINITIALIZED for 2s [ 646.471638] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aab303d-69ac-46ee-a55d-5ef201d83e38: rpc.has_security_group_logging(os_id): False [ 646.494157] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.494157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.494511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.495119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.495283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.495663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.495819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.495944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.496217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.496325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.496439] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 is going to be created. [ 646.604615] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.604615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.604615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.604615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.604973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.619201] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: IN_PROGRESS for 2s [ 646.787420] env[65119]: INFO networking_nsxv3.common.synchronization [req-79ebba3f-9509-4df6-b9f2-8849ddf7e2d2 req-93b8d2eb-5dc8-4d2a-9bc6-b45d4987c678 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 646.787551] env[65119]: INFO networking_nsxv3.common.synchronization [req-79ebba3f-9509-4df6-b9f2-8849ddf7e2d2 req-93b8d2eb-5dc8-4d2a-9bc6-b45d4987c678 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 646.787681] env[65119]: INFO networking_nsxv3.common.synchronization [req-79ebba3f-9509-4df6-b9f2-8849ddf7e2d2 req-93b8d2eb-5dc8-4d2a-9bc6-b45d4987c678 service nova] Enqueued Resource ID: 97fa3aef-578e-415a-a2a6-0be2a36dda26 with Priority: HIGHEST for action port [ 646.788341] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 646.788520] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 646.788659] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97fa3aef-578e-415a-a2a6-0be2a36dda26 with Priority: HIGHEST for action port [ 646.788955] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.790422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.790422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.790422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.790422] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.791933] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.792478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.792556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.792757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.792962] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.793098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.793210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.793491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.793551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.793858] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.794874] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-97fa3aef-578e-415a-a2a6-0be2a36dda26 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.794985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.798153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.798153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.798153] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97fa3aef-578e-415a-a2a6-0be2a36dda26',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.178257] env[65119]: INFO networking_nsxv3.common.synchronization [None req-44fa7288-7968-4391-a1f3-3fe12e0af720 None None] Enqueued Resource ID: 065b7ada-8784-499e-9c0c-44864e23450f with Priority: HIGHEST for action port [ 647.180301] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065b7ada-8784-499e-9c0c-44864e23450f with Priority: HIGHEST for action port [ 647.180301] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-065b7ada-8784-499e-9c0c-44864e23450f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.180301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-065b7ada-8784-499e-9c0c-44864e23450f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.180301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-065b7ada-8784-499e-9c0c-44864e23450f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.180301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-065b7ada-8784-499e-9c0c-44864e23450f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.180301] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065b7ada-8784-499e-9c0c-44864e23450f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.292349] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.292608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.299066] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.300057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97fa3aef-578e-415a-a2a6-0be2a36dda26 with status ACTIVE [ 647.300417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.301170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.301170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.301170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.301170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.301170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.301170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.301573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.301573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.301573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.301694] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.302151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.302151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.302322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.302454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.302572] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97fa3aef-578e-415a-a2a6-0be2a36dda26 is going to be updated. [ 647.356359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.356359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.356612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.357201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.357751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.358075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97fa3aef-578e-415a-a2a6-0be2a36dda26" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.683500] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 065b7ada-8784-499e-9c0c-44864e23450f [ 647.683819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.683897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.683966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.684258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.684347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.684431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:065b7ada-8784-499e-9c0c-44864e23450f already deleted. [ 647.684512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-065b7ada-8784-499e-9c0c-44864e23450f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.804390] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.049982] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 648.050248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.050460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.050732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.050940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.051077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.051149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.051298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.051397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.051519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.051657] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.312882] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.313153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.313236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.313463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.313575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.313678] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be created. [ 648.342413] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.342413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.342576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.342687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.342824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.357499] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: UNINITIALIZED for 2s [ 648.554901] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.558029] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.558029] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.558029] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.558029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.558814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.558814] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.631620] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: SUCCESS [ 648.631736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.053946] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7f304186-bbeb-434d-9c12-75b46cf3e7d5 None None] Enqueued Resource ID: 1d9f90ee-9be9-4958-9854-6b34c83b36da with Priority: HIGHEST for action port [ 649.054785] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9f90ee-9be9-4958-9854-6b34c83b36da with Priority: HIGHEST for action port [ 649.055631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d9f90ee-9be9-4958-9854-6b34c83b36da taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.057369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d9f90ee-9be9-4958-9854-6b34c83b36da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.057369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d9f90ee-9be9-4958-9854-6b34c83b36da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.057808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d9f90ee-9be9-4958-9854-6b34c83b36da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.057808] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d9f90ee-9be9-4958-9854-6b34c83b36da',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.062228] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154abdb7-4268-41a3-bf4b-26f5e9656c76: rpc.has_security_group_logging(os_id): False [ 649.087267] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.087349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.087386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.087602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.088736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.088736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.088736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.091286] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.091286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.091286] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 649.183570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.183718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.183786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.184030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.184210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.198105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 649.562752] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d9f90ee-9be9-4958-9854-6b34c83b36da [ 649.563447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.563550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.563670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.563961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.564114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.564648] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d9f90ee-9be9-4958-9854-6b34c83b36da already deleted. [ 649.564648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d9f90ee-9be9-4958-9854-6b34c83b36da" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.577562] env[65119]: INFO networking_nsxv3.common.synchronization [req-51e25457-ee01-4f46-8696-b3f298ecebea req-6c274c08-6958-4f33-855b-727ea868af37 tempest-SecurityGroupRulesTestJSON-1624136272 tempest-SecurityGroupRulesTestJSON-1624136272-project-member] Enqueued Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 649.578570] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df211d86-e270-49cf-b482-a62ee9e29fc8 with Priority: HIGHEST for action security_group_rules [ 649.578903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df211d86-e270-49cf-b482-a62ee9e29fc8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.579045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.579115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.579315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.579514] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df211d86-e270-49cf-b482-a62ee9e29fc8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.104075] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.104075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.104075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.104440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.104440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.104440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df211d86-e270-49cf-b482-a62ee9e29fc8 already deleted. [ 650.104541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df211d86-e270-49cf-b482-a62ee9e29fc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.148022] env[65119]: INFO networking_nsxv3.common.synchronization [req-6b04a54e-74b1-4ce8-9df9-cc11a9906d1f req-65d33007-5bac-45b4-9201-710ac9453551 tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 650.148022] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 650.148022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.148022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.373740] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 650.373962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.375348] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.375348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.375348] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.379443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.379702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.380322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.380322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.380322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.380322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.380536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.380536] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.766291] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.766291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.766291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.768581] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.769104] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.770041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.770041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.770041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.770041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.770354] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.770354] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.771075] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.771075] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.771075] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.771075] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.771075] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.798234] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.798234] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.798234] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.798234] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.798824] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.799338] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.799642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.800284] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.800594] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adec2fbd-888b-45b3-9c3c-c4bec1c8b28d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.883143] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.883336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.883883] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.000663] env[65119]: INFO networking_nsxv3.common.synchronization [req-701127d8-3918-465a-8565-f508af9b178c req-63a0054e-09ca-4a58-9ee4-cb4c543da2bd tempest-InstanceActionsV221TestJSON-531095894 tempest-InstanceActionsV221TestJSON-531095894-project-member] Enqueued Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 651.001416] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGHEST for action security_group_members [ 651.001719] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.001841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.001913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.002128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.002290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.002432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.002506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.002688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.002788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.002887] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.216605] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 651.217042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.303305] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.303561] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.303648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.304176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.304290] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.304363] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port adec2fbd-888b-45b3-9c3c-c4bec1c8b28d not found, creating... [ 651.304640] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.304809] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.304936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.305221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.305385] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.305727] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.305927] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.309476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.309798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.309960] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.310170] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: adec2fbd-888b-45b3-9c3c-c4bec1c8b28d is going to be created. [ 651.334191] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.334610] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.336586] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.336586] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.336857] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.337017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.390025] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.506269] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.506499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.506499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.507245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.507245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.507245] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.507245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.507245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.507520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.507520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.507520] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f is going to be updated. [ 651.543915] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.544096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.544143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.544372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.544533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.562621] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: IN_PROGRESS for 2s [ 651.893492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.893492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.893492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.893492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.893492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.893492] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 651.940824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.941076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.941130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.943522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.943522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.954553] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 652.082221] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 652.082221] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 652.082518] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 652.082577] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 652.086381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.086381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.086381] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.086381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.086381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.086381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.087208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.087208] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.089052] env[65119]: INFO networking_nsxv3.common.synchronization [req-6b04a54e-74b1-4ce8-9df9-cc11a9906d1f req-eb70eac9-9953-4ba2-b6f0-82779a324369 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 652.089133] env[65119]: INFO networking_nsxv3.common.synchronization [req-6b04a54e-74b1-4ce8-9df9-cc11a9906d1f req-eb70eac9-9953-4ba2-b6f0-82779a324369 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 652.089310] env[65119]: INFO networking_nsxv3.common.synchronization [req-6b04a54e-74b1-4ce8-9df9-cc11a9906d1f req-eb70eac9-9953-4ba2-b6f0-82779a324369 service nova] Enqueued Resource ID: adec2fbd-888b-45b3-9c3c-c4bec1c8b28d with Priority: HIGHEST for action port [ 652.092812] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 652.092812] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 652.092812] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec2fbd-888b-45b3-9c3c-c4bec1c8b28d with Priority: HIGHEST for action port [ 652.092812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.092812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.092812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.092812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.092812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.092812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.092812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.092812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.092812] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adec2fbd-888b-45b3-9c3c-c4bec1c8b28d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.129966] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 652.129966] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 652.130123] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_rules [ 652.130344] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 652.130344] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e4625e7-afc4-4fd5-a0d6-ce26f4bda584 req-b67c62e2-e6f0-4f2a-8d8d-b534ca5828ce tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 652.131292] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 652.134020] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_rules [ 652.134020] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 652.134506] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 652.134506] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 652.135033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.135245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.135373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.135871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.136018] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.137448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.138405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.138405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.138405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.138405] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.139437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d06485-a0a9-4364-8300-c7d883ff2b16 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.139660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.140319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.140622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.140765] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d06485-a0a9-4364-8300-c7d883ff2b16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.143372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.143372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.143531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.143592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.589478] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.591601] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.595055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adec2fbd-888b-45b3-9c3c-c4bec1c8b28d with status ACTIVE [ 652.595222] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.595362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.595427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.595731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.595830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.595971] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.596095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.596157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.596302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.600025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.600025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.600025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.600025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.600025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.600025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.600025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adec2fbd-888b-45b3-9c3c-c4bec1c8b28d is going to be updated. [ 652.645896] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.646018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.646184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.646485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.646728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.647065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adec2fbd-888b-45b3-9c3c-c4bec1c8b28d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.647434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.647529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.650035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d06485-a0a9-4364-8300-c7d883ff2b16 with status ACTIVE [ 652.650035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.650035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.650035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.650035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.650035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 is going to be updated. [ 652.651159] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.651393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.690597] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.690867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.690867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.691045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.691185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.691423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.710473] env[65119]: INFO networking_nsxv3.common.synchronization [req-91ac3579-570c-4a7e-aed2-879727f86695 req-e855b51a-f2e6-4363-81c5-14ac0e8687a3 tempest-ImagesNegativeTestJSON-1950409452 tempest-ImagesNegativeTestJSON-1950409452-project-member] Enqueued Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 652.711129] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGHEST for action security_group_members [ 652.711582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.711746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.711863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.712075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.712321] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.712500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.712606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.712878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.713037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.713189] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.897150] env[65119]: INFO networking_nsxv3.common.synchronization [req-7146ec94-304c-49dd-ad72-a1dce72132b5 req-4e72f639-c485-4f7a-a8a4-040b285f78ed tempest-ServersAdminNegativeTestJSON-1695298807 tempest-ServersAdminNegativeTestJSON-1695298807-project-member] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 652.898027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 652.899226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.899226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.899226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.899857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.900096] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.900277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.900396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.900646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.901139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.901469] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.091057] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.095568] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.216159] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.216159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.216159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.216159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.216576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.216576] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.216712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.216712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.217249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.217249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.217249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a is going to be updated. [ 653.285839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.286112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.286528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.286851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.287164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.301404] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.301741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.301741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.301932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.302198] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.302378] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.302464] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.302720] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.302907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.303137] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.303243] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.303344] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.303462] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.303605] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.303696] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.303790] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.305658] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: IN_PROGRESS for 2s [ 653.333210] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.333466] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.333638] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.333809] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.334344] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-7de72ae5-70df-43a3-a4d5-154a39cecb5f taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.334344] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.334632] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.338025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.338025] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de72ae5-70df-43a3-a4d5-154a39cecb5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.404893] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.577992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f in Status: SUCCESS [ 653.577992] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f deletion is rescheduled due to dependency. [ 653.577992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.597738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.598091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.598091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.598329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.598437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.598566] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 653.603331] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.603515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.603576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.603816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.603903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.604926] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 is going to be created. [ 653.635102] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.635102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.635102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.635102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.635102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.647516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.647666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.647743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.647976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.648147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.650028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 in Status: UNINITIALIZED for 2s [ 653.660013] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 653.838879] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.839227] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.839460] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.839768] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.839916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.840091] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 7de72ae5-70df-43a3-a4d5-154a39cecb5f not found, creating... [ 653.840376] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.840540] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.840649] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.840893] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.841152] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.841502] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.841716] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.842017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.843107] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.843107] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.843107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 7de72ae5-70df-43a3-a4d5-154a39cecb5f is going to be created. [ 653.889283] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.889557] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.889735] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.890040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.890249] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.890477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.907481] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.967985] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 653.968429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.968778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.969193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.969489] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.969690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.969813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.970156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.970285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.970470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.970761] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.970929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.971067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.971357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.971577] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.971685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.971754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.971968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.972295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.972452] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.973796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.974055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.974340] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.974506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.974636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.975073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.975277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.975550] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.412741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.412741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.415733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415733] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be updated. [ 654.455647] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.455898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.456163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.456329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.467586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 654.478214] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 511a8f2f-3767-4d34-9d44-c9a6cd510c1a: rpc.has_security_group_logging(os_id): False [ 654.479490] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.504511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.504750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.504750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.505122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.505122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.505401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.505503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.505571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.505742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.505821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.506028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.506136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.506263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.506409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.506491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.506740] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.506842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.506955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.507158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.507236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.507324] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be created. [ 654.597612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.598096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.598389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.598644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.598749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.612860] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [req-7146ec94-304c-49dd-ad72-a1dce72132b5 req-e70f78f7-9eb5-4547-b424-e712f5522271 service nova] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_rules [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [req-7146ec94-304c-49dd-ad72-a1dce72132b5 req-e70f78f7-9eb5-4547-b424-e712f5522271 service nova] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [req-7146ec94-304c-49dd-ad72-a1dce72132b5 req-e70f78f7-9eb5-4547-b424-e712f5522271 service nova] Enqueued Resource ID: 7de72ae5-70df-43a3-a4d5-154a39cecb5f with Priority: HIGHEST for action port [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_rules [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 654.655675] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7de72ae5-70df-43a3-a4d5-154a39cecb5f with Priority: HIGHEST for action port [ 654.655675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.656301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.656301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.656301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.656301] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.657091] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.657162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.657370] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7de72ae5-70df-43a3-a4d5-154a39cecb5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.657475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.657537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.657722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.657797] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de72ae5-70df-43a3-a4d5-154a39cecb5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.983729] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.164076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.164076] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7de72ae5-70df-43a3-a4d5-154a39cecb5f with status ACTIVE [ 655.164076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.164076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.165513] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.167280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.167280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.167280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.167280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.167280] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7de72ae5-70df-43a3-a4d5-154a39cecb5f is going to be updated. [ 655.203139] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.204582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.204582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.204582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.204582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.204582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7de72ae5-70df-43a3-a4d5-154a39cecb5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.315742] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a in Status: SUCCESS [ 655.315742] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a deletion is rescheduled due to dependency. [ 655.315742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.486991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.486991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.486991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.487383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.487383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.487602] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 655.525169] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.527410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.527563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.527840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.528058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.543388] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 655.664223] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 in Status: SUCCESS [ 655.664739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.664739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.664739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.665051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.665216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.665289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.665557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.665635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.665725] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.668932] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 655.669194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.669472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.669616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.669806] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.669936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.670029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.670592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.670592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.670592] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.762989] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5d11bbb-f3df-44c9-90af-8aaa6b059ea9 req-561c98e7-3b82-4552-8ce0-85bb759d5233 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 655.762989] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5d11bbb-f3df-44c9-90af-8aaa6b059ea9 req-561c98e7-3b82-4552-8ce0-85bb759d5233 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 655.763441] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 655.763586] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 with Priority: HIGHEST for action security_group_members [ 655.764499] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.764499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.764713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.764713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.827205] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5d11bbb-f3df-44c9-90af-8aaa6b059ea9 req-561c98e7-3b82-4552-8ce0-85bb759d5233 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 655.827664] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5d11bbb-f3df-44c9-90af-8aaa6b059ea9 req-561c98e7-3b82-4552-8ce0-85bb759d5233 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 655.828169] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5d11bbb-f3df-44c9-90af-8aaa6b059ea9 req-561c98e7-3b82-4552-8ce0-85bb759d5233 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 655.832045] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_rules [ 655.832045] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 655.832045] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 with Priority: HIGHEST for action port [ 655.832045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.832685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.832726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.833140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.833246] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d06485-a0a9-4364-8300-c7d883ff2b16 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.833414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.833500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.833807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.833919] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d06485-a0a9-4364-8300-c7d883ff2b16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.168472] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.172661] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.180585] env[65119]: INFO networking_nsxv3.common.synchronization [req-11f10a4f-f337-493b-a5e6-2369d5af0a61 req-9157d012-2d65-4f73-9d25-adfac8fe76a7 tempest-DeleteServersAdminTestJSON-506825564 tempest-DeleteServersAdminTestJSON-506825564-project-member] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 656.181259] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 656.181676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.181747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.181803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.182918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.183279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.183401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.183581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.183925] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.337215] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d06485-a0a9-4364-8300-c7d883ff2b16 with status ACTIVE [ 656.337623] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.338670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.338670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.338670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.338670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.338670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.338971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.338971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.339169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.339306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.339588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.339736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.340344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.340652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.341274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.341381] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d06485-a0a9-4364-8300-c7d883ff2b16 is going to be updated. [ 656.371283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.371283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.371283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.371283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.371283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.371283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d06485-a0a9-4364-8300-c7d883ff2b16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.463042] env[65119]: INFO networking_nsxv3.common.synchronization [req-acb8e331-8083-4b0e-93e3-2ef34a375185 req-08993cd8-5e56-42df-bc4f-650d82afc73d tempest-ServerDiagnosticsNegativeTest-856482237 tempest-ServerDiagnosticsNegativeTest-856482237-project-member] Enqueued Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 656.463343] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGHEST for action security_group_members [ 656.463819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.463947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.464028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.464422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.464966] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.464966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.464966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.464966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.465260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.465260] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.485710] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 656.486039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.486119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.486344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.486559] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.486734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.486734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.486876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.487077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.487200] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.630661] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 656.630923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.631137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.631425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.631486] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.670869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.675567] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.686135] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.687589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.687589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.687589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be updated. [ 656.718336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.718507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.718576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.718804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.719364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.730559] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 656.968285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.968439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.968557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.968729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.968828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.969059] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.969186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.969281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.969416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.969495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.969587] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 is going to be updated. [ 656.992312] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.005143] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.005334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.005334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.005526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.005674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.015268] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: IN_PROGRESS for 2s [ 657.062349] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.062349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.062349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.062349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.066572] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.066760] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.066946] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.067360] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.067554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.067993] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.067993] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.067993] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.068244] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.068244] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.068407] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.068585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.072719] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c29e0996-459b-49a9-95e6-67ceb5757ffb None None] Enqueued Resource ID: 9134bf0e-301a-42e0-ad46-627cf62f771d with Priority: HIGHEST for action port [ 657.073611] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9134bf0e-301a-42e0-ad46-627cf62f771d with Priority: HIGHEST for action port [ 657.074537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-9134bf0e-301a-42e0-ad46-627cf62f771d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.074664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9134bf0e-301a-42e0-ad46-627cf62f771d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.074735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9134bf0e-301a-42e0-ad46-627cf62f771d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.074990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9134bf0e-301a-42e0-ad46-627cf62f771d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.075090] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9134bf0e-301a-42e0-ad46-627cf62f771d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.094805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.095029] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.095109] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.095290] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.095616] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-90ca609f-935d-4584-a3f7-4953be477ffb taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.095787] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.095920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.096299] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.096442] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90ca609f-935d-4584-a3f7-4953be477ffb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.135157] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.135457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.173840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.173840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.174131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.174131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.174209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.174352] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 is going to be updated. [ 657.178183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.178355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.178432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.178668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.178777] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.178893] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 657.207166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.207353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.207419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.207628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.207814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.212621] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.212621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.212621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.212621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.212621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.227026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 657.227165] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 in Status: IN_PROGRESS for 2s [ 657.494458] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.555184] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 657.555448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.555598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.555839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.556114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.556309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.556309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.556474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.556593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.556709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.556709] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.577403] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9134bf0e-301a-42e0-ad46-627cf62f771d [ 657.577477] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.578450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.578450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.578450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.578450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.578450] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9134bf0e-301a-42e0-ad46-627cf62f771d already deleted. [ 657.578450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9134bf0e-301a-42e0-ad46-627cf62f771d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.602031] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.602031] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 90ca609f-935d-4584-a3f7-4953be477ffb not found, creating... [ 657.602031] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.602031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.602677] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.602677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.602677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.602677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.602677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.602677] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 90ca609f-935d-4584-a3f7-4953be477ffb is going to be created. [ 657.640028] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.640028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.640028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.640028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.640028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.640028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.998525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.999048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.999048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.999048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.999236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.999236] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be updated. [ 658.029340] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.029340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.029340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.029340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.029340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.038183] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 658.059846] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.060017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.060079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.060303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.060539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.060594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.060629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.060765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.060850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.060939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.061525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.061525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.061525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.061525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.061525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.061797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.061797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.061797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.061895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.061929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.062043] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.428196] env[65119]: INFO networking_nsxv3.common.synchronization [req-11f10a4f-f337-493b-a5e6-2369d5af0a61 req-e623c1cc-043e-497c-a23c-a6dd56b41337 service nova] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_rules [ 658.428510] env[65119]: INFO networking_nsxv3.common.synchronization [req-11f10a4f-f337-493b-a5e6-2369d5af0a61 req-e623c1cc-043e-497c-a23c-a6dd56b41337 service nova] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 658.429037] env[65119]: INFO networking_nsxv3.common.synchronization [req-11f10a4f-f337-493b-a5e6-2369d5af0a61 req-e623c1cc-043e-497c-a23c-a6dd56b41337 service nova] Enqueued Resource ID: 90ca609f-935d-4584-a3f7-4953be477ffb with Priority: HIGHEST for action port [ 658.430555] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_rules [ 658.430555] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 658.430555] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ca609f-935d-4584-a3f7-4953be477ffb with Priority: HIGHEST for action port [ 658.431232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.431232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.431232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.431646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.431922] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.433517] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.433998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.434741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-90ca609f-935d-4584-a3f7-4953be477ffb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.434741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.434741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.435221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.435342] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90ca609f-935d-4584-a3f7-4953be477ffb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.565121] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 511a8f2f-3767-4d34-9d44-c9a6cd510c1a: rpc.has_security_group_logging(os_id): False [ 658.587137] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.587137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.587137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.587137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.587137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.587137] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.587402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.587402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.587963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.587963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.587963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.587963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.588292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.588327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.588430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.588626] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.588729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.588795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.588949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.589039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.589212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 658.682232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.682325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.682368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.683031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.683031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.735353] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 658.748094] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 658.748357] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 deletion is rescheduled due to dependency. [ 658.748397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.748725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.748782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.748957] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.749096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.749153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.752214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.752484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.752776] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.937024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.937225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.939858] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90ca609f-935d-4584-a3f7-4953be477ffb with status ACTIVE [ 658.939858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.939858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.939858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.939858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.939858] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90ca609f-935d-4584-a3f7-4953be477ffb is going to be updated. [ 658.967871] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.967871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.967871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.967871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.967871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.967871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90ca609f-935d-4584-a3f7-4953be477ffb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.031204] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4720d561-4590-44ad-bcfd-bb12e7297342 in Status: SUCCESS [ 659.031979] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 deletion is rescheduled due to dependency. [ 659.032247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.037189] env[65119]: INFO networking_nsxv3.common.synchronization [req-5db131e9-5586-4002-981f-c845ce82dff7 req-ff8665bd-c0e9-4e6e-9072-e6674b702e08 tempest-VolumesAdminNegativeTest-2052342638 tempest-VolumesAdminNegativeTest-2052342638-project-member] Enqueued Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 659.037584] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 659.037887] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.038054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.038372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.038614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.038799] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.038912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.038970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.039130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.039219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.039348] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.243717] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 in Status: SUCCESS [ 659.243939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.245541] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 659.245541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.245541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.245541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.245541] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.245899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.245952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.246211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.246355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.246501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.246676] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.247706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.247884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.249163] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.249163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.249163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.249163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.249163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.249163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.249163] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.250539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.250688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.250863] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.252237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.252343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.253118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.253118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.253118] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.253991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.253991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.253991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.253991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254322] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.257636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.541895] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.542095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.542181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.542408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.542516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.542739] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.542852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.542913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.543103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.543221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.543282] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 already deleted. [ 659.543337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.545935] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.546127] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-598" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.546230] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-598" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.547313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-598" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.547313] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.547505] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.547505] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.548616] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.548616] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.548616] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.548616] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.548616] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.548616] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.549047] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.549047] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.549047] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.574276] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.574423] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.574640] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.574697] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-598" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.575054] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-a3877508-8c80-482f-b988-8464164f4209 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.575194] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.575310] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.575630] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.575765] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3877508-8c80-482f-b988-8464164f4209',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.642422] env[65119]: INFO networking_nsxv3.common.synchronization [None req-419d085a-cf65-4284-ab2a-7dff8804d759 None None] Enqueued Resource ID: 846868a7-484b-43a3-ba91-bb831a1b51c7 with Priority: HIGHEST for action port [ 659.642998] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846868a7-484b-43a3-ba91-bb831a1b51c7 with Priority: HIGHEST for action port [ 659.643374] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-846868a7-484b-43a3-ba91-bb831a1b51c7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.647365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-846868a7-484b-43a3-ba91-bb831a1b51c7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.647446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-846868a7-484b-43a3-ba91-bb831a1b51c7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.647762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-846868a7-484b-43a3-ba91-bb831a1b51c7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.647893] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('846868a7-484b-43a3-ba91-bb831a1b51c7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.751782] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f14d570d-4e55-4f1c-89d1-e9cb3eb839b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.758348] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.759468] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.759602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.759813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.759923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.759990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.760220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.760311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.760493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.760590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.760692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.760798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.760874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.760956] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 is going to be deleted. [ 659.765341] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.937510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.937704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.937704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.938056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.938056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.938182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.973017] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e2998249-5ff2-4251-a986-c17066285039 None None] Enqueued Resource ID: 188b269e-d933-449e-8f30-fc66bbc8a138 with Priority: HIGHEST for action port [ 659.973017] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 188b269e-d933-449e-8f30-fc66bbc8a138 with Priority: HIGHEST for action port [ 659.973017] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-188b269e-d933-449e-8f30-fc66bbc8a138 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.973017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-188b269e-d933-449e-8f30-fc66bbc8a138" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.973017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-188b269e-d933-449e-8f30-fc66bbc8a138" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.973017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-188b269e-d933-449e-8f30-fc66bbc8a138" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.973017] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('188b269e-d933-449e-8f30-fc66bbc8a138',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.049171] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 660.049927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.049927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.049927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.050095] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.050167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.050167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.050415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.050415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.050881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.050881] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.081536] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.081763] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.082371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.082371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.082371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.082754] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port a3877508-8c80-482f-b988-8464164f4209 not found, creating... [ 660.083437] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.083437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.083437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.083648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.083773] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.084642] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.084775] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.084894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.085116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.088822] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.088911] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: a3877508-8c80-482f-b988-8464164f4209 is going to be created. [ 660.108964] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.109210] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.109336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.109621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.109922] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.110176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.152488] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 846868a7-484b-43a3-ba91-bb831a1b51c7 [ 660.152723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.152864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.152938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.153181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.153291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.153431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:846868a7-484b-43a3-ba91-bb831a1b51c7 already deleted. [ 660.153523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-846868a7-484b-43a3-ba91-bb831a1b51c7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255333] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f14d570d-4e55-4f1c-89d1-e9cb3eb839b3: rpc.has_security_group_logging(os_id): False [ 660.265564] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.267492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.267713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.267807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.268112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.268301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.268543] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be updated. [ 660.283320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.283493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.283587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.285740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.285740] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.286893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.286893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.286893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.286893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.286893] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 is going to be created. [ 660.313070] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.313329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.313329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.313462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.313678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.316024] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3], does not exist path=[/infra/domains/default/groups/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3]."\n}' [ 660.316279] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 [ 660.316431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 660.328445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 660.386880] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.387115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.387194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.387423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.388175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.388459] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.389121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.389121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.389121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.389121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.389121] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.389417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.389417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.389417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.389417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.389785] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 is going to be created. [ 660.430580] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3], does not exist path=[/infra/domains/default/groups/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 [ 660.430819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f14d570d-4e55-4f1c-89d1-e9cb3eb839b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.432726] env[65119]: Traceback (most recent call last): [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 660.432726] env[65119]: return func(*args, **kwargs) [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 660.432726] env[65119]: res.raise_for_status() [ 660.432726] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 660.432726] env[65119]: raise HTTPError(http_error_msg, response=self) [ 660.432726] env[65119]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 [ 660.432726] env[65119]: During handling of the above exception, another exception occurred: [ 660.432726] env[65119]: Traceback (most recent call last): [ 660.432726] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 660.432726] env[65119]: listener.cb(fileno) [ 660.432726] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 660.432726] env[65119]: result = function(*args, **kwargs) [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 660.432726] env[65119]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 660.432726] env[65119]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 660.432726] env[65119]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 660.432726] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 660.432726] env[65119]: res.raise_for_status() [ 660.432726] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 660.432726] env[65119]: raise HTTPError(http_error_msg, response=self) [ 660.432726] env[65119]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f14d570d-4e55-4f1c-89d1-e9cb3eb839b3 [ 660.432726] env[65119]: Removing descriptor: 20 [ 660.476676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 188b269e-d933-449e-8f30-fc66bbc8a138 [ 660.477023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.477308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.477391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.477615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.477726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.477830] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:188b269e-d933-449e-8f30-fc66bbc8a138 already deleted. [ 660.477913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-188b269e-d933-449e-8f30-fc66bbc8a138" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.553157] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.553424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.553536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.553867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.554210] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.554324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.554424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.554686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.554837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.554949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.555153] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.555255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.555317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.555468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.555611] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.555703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.555765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.555901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.555977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.556079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.556171] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.814658] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.814658] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.814658] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 660.814658] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.814658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.820132] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 660.882602] env[65119]: INFO networking_nsxv3.common.synchronization [req-5db131e9-5586-4002-981f-c845ce82dff7 req-a3590fe3-be2e-4099-8e10-341d33093e82 service nova] Enqueued Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_rules [ 660.882988] env[65119]: INFO networking_nsxv3.common.synchronization [req-5db131e9-5586-4002-981f-c845ce82dff7 req-a3590fe3-be2e-4099-8e10-341d33093e82 service nova] Enqueued Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 660.882988] env[65119]: INFO networking_nsxv3.common.synchronization [req-5db131e9-5586-4002-981f-c845ce82dff7 req-a3590fe3-be2e-4099-8e10-341d33093e82 service nova] Enqueued Resource ID: a3877508-8c80-482f-b988-8464164f4209 with Priority: HIGHEST for action port [ 660.883628] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_rules [ 660.883628] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 660.883833] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3877508-8c80-482f-b988-8464164f4209 with Priority: HIGHEST for action port [ 660.884148] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.884317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.884397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.884664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.884746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.885680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.885810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.885916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.886077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.886239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.886301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.886428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.886898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.887080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.887219] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.891179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3877508-8c80-482f-b988-8464164f4209 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.891179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.891179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.891179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.891179] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3877508-8c80-482f-b988-8464164f4209',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.058714] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c59b58cb-0641-49be-856b-56dc606d886a: rpc.has_security_group_logging(os_id): False [ 661.081236] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.081236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.081236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.081236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.105103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.105258] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.105409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.105513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.105650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.105753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.105954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.106068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.106133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.106536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.106536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.106536] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.106858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.106858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.106858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.107280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.107280] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be updated. [ 661.229389] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.229605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.229605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.229817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.229962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.247644] env[65119]: INFO networking_nsxv3.common.synchronization [req-92ff32a6-6c21-47d4-ba4c-f5f0c9dfa321 req-57a340a0-e661-43e5-b161-78f482066932 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 661.250383] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 661.250383] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.250383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.250383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.250383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.250383] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.250383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.250383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.251560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.252838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.252838] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.262098] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 661.396427] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3877508-8c80-482f-b988-8464164f4209 with status ACTIVE [ 661.396676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.396835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.396906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.397159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.397256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.397445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.397571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.397611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.397758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.397837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.398060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.398198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.398264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.398417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.398492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.398578] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3877508-8c80-482f-b988-8464164f4209 is going to be updated. [ 661.402946] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.403908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.404068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.438886] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.438886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.438886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.438886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.438886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.438886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3877508-8c80-482f-b988-8464164f4209" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.736856] env[65119]: INFO networking_nsxv3.common.synchronization [req-1e4898fd-7421-42c3-9b49-eb602e1469bf req-af1c97e8-ef90-4b5f-9b02-371f648afa08 tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 661.736992] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 661.737637] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.740575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.740695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.740878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741074] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.741206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.741255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.741405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.741586] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.756847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.756847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.756847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.756847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.792539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.792842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.792981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.793184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.793321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.793413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.793529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 661.831495] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.831655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.831733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.831946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.832107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.844176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 661.907448] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.233577] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.233917] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.233917] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.236031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.236031] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.236031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.237230] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.237541] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.237692] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.237968] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.238121] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.238248] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.238355] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.238465] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.240023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.240023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.247457] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.270924] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.271157] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.271345] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.271550] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-515" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.272024] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-f13fbc82-ae53-42af-a63f-3692c28ce9e9 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.272161] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.272204] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.272529] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.272653] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13fbc82-ae53-42af-a63f-3692c28ce9e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.358748] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 662.358748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.358748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.359016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.359239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.359323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.359323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.359536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.359597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.359688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.359780] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.411632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.411848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.411922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.412176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.412297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.412407] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 is going to be created. [ 662.445597] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.445836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.445935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.446189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.446464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.458793] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: UNINITIALIZED for 2s [ 662.537863] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a64e760b-2b53-493f-b79b-c32400bf0094 None None] Enqueued Resource ID: a7839402-377b-40c3-bf55-137f2419da92 with Priority: HIGHEST for action port [ 662.538785] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7839402-377b-40c3-bf55-137f2419da92 with Priority: HIGHEST for action port [ 662.538987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7839402-377b-40c3-bf55-137f2419da92 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.539299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7839402-377b-40c3-bf55-137f2419da92" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.539299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7839402-377b-40c3-bf55-137f2419da92" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.539677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7839402-377b-40c3-bf55-137f2419da92" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.539811] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7839402-377b-40c3-bf55-137f2419da92',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.753511] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.783641] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.783641] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port f13fbc82-ae53-42af-a63f-3692c28ce9e9 not found, creating... [ 662.783641] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.783641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.784081] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.784081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.784081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.784081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.784081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.784081] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: f13fbc82-ae53-42af-a63f-3692c28ce9e9 is going to be created. [ 662.812841] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.813464] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.813662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.814042] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.814343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.814862] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.831473] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 662.831710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.831905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.832314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.832726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.832973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.833167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.833389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.833522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.833658] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.861802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.862049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.862049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.862582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.862582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.862738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.862738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.862833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.862920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.863082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.863200] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.863295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.863353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.863514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.863683] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.863934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.863934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.864058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.864105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.864169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.864263] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.042574] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7839402-377b-40c3-bf55-137f2419da92 [ 663.042809] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.042949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.043022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.043328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.043436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.043436] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7839402-377b-40c3-bf55-137f2419da92 already deleted. [ 663.043517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7839402-377b-40c3-bf55-137f2419da92" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.258091] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.259441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.259441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.259441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.259441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.259441] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 663.286901] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 663.287425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.306668] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.307405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.308035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.308134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.308283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.323352] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 663.337912] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.366067] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1d77171-74cb-4523-ba62-d51303f9c0b4: rpc.has_security_group_logging(os_id): False [ 663.391133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.391133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.391133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.391133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.432092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.432367] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.432519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.432591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.432793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.432889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.433106] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.433232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.433298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.433921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.433921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.434443] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.434625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.434702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.434856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.435382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.435382] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be updated. [ 663.558537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.560602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.560750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.562648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.564464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.583359] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 663.654450] env[65119]: INFO networking_nsxv3.common.synchronization [req-1e4898fd-7421-42c3-9b49-eb602e1469bf req-3feb4221-18ed-4bb7-8e22-a9593d3e39c1 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 663.654450] env[65119]: INFO networking_nsxv3.common.synchronization [req-1e4898fd-7421-42c3-9b49-eb602e1469bf req-3feb4221-18ed-4bb7-8e22-a9593d3e39c1 service nova] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 663.654450] env[65119]: INFO networking_nsxv3.common.synchronization [req-1e4898fd-7421-42c3-9b49-eb602e1469bf req-3feb4221-18ed-4bb7-8e22-a9593d3e39c1 service nova] Enqueued Resource ID: f13fbc82-ae53-42af-a63f-3692c28ce9e9 with Priority: HIGHEST for action port [ 663.655797] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_rules [ 663.655797] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 663.655797] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f13fbc82-ae53-42af-a63f-3692c28ce9e9 with Priority: HIGHEST for action port [ 663.656198] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.656378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.656466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.656776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.656885] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.658523] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.659170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.659170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f13fbc82-ae53-42af-a63f-3692c28ce9e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.659170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.659170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.660155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.660155] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13fbc82-ae53-42af-a63f-3692c28ce9e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.840954] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.890448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 663.890448] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 663.890448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.162184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.162391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.162545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f13fbc82-ae53-42af-a63f-3692c28ce9e9 with status ACTIVE [ 664.162763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.162935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.163038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.163270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.163364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.163546] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.163645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.163708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.163872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.163976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.164212] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.164310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.164379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.164531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.164607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.164694] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f13fbc82-ae53-42af-a63f-3692c28ce9e9 is going to be updated. [ 664.195491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.195697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.195697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.195922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.196199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.196385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f13fbc82-ae53-42af-a63f-3692c28ce9e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.342060] env[65119]: INFO networking_nsxv3.common.synchronization [req-164cb8a9-762e-44ed-804f-c8563ecfa65f req-4bec24ac-6658-4a7e-8305-3037aa689c47 tempest-ImagesOneServerTestJSON-1737876565 tempest-ImagesOneServerTestJSON-1737876565-project-member] Enqueued Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 664.343506] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 664.343822] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.343951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.344028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.344281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.344445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.344550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.344607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.344753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.344839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.344935] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.346082] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.346278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.346278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.346477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.346574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.346617] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 664.405230] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.405230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.405230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.405230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.405230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.415733] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 664.471690] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: SUCCESS [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.471690] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.471690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.471690] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.849509] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.849686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.849760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.849981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.850094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.850302] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.850403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.850465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.850625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.850701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.850786] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07660c72-b919-4d62-b37d-9ae294d80c7d already deleted. [ 664.850867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.888053] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.888266] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-641" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.888410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-641" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.888736] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-641" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.888985] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.889477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.889884] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.890180] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.890413] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.890682] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.890822] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.890960] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.891169] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.891315] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.891446] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.891596] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.917525] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.917905] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.918902] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.919161] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-641" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.919584] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-31b77498-2547-49b7-b795-3c1c4171d0ef taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.921663] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.921791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.922163] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.922309] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b77498-2547-49b7-b795-3c1c4171d0ef',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.976872] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.976872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.977209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.977401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.977552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.977657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.977717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.977867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.978155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.978155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.978275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.978366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.978450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.978563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.979179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.979179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.979179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.979179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.979179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.979179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.979520] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.334798] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 665.335181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.335400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.335656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.335864] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.336052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.336142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.336268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.336389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.336515] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.424436] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.424828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.424828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.425014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.425177] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.425331] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 31b77498-2547-49b7-b795-3c1c4171d0ef not found, creating... [ 665.425592] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.425746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.425856] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.426095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.426228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.426507] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.426694] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.426769] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.427039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.427180] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.427318] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 31b77498-2547-49b7-b795-3c1c4171d0ef is going to be created. [ 665.450560] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.451018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.451018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.451217] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.451493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.451911] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.482255] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75aafba1-23a9-48ba-a855-7337f0a9b868: rpc.has_security_group_logging(os_id): False [ 665.503717] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.503893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.503934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.504236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.504329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.504532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.504634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.504697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.504906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.505041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.505277] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.505387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.505448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.505778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.505858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.506065] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.506605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.506605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.506605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.506605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.506605] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 is going to be created. [ 665.614682] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 665.614930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.660829] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.661058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.661167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.661420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.661643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.674818] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: IN_PROGRESS for 2s [ 665.840124] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.234916] env[65119]: INFO networking_nsxv3.common.synchronization [req-164cb8a9-762e-44ed-804f-c8563ecfa65f req-8f559d6c-6c36-42dc-8716-d48bccc92e84 service nova] Enqueued Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_rules [ 666.235223] env[65119]: INFO networking_nsxv3.common.synchronization [req-164cb8a9-762e-44ed-804f-c8563ecfa65f req-8f559d6c-6c36-42dc-8716-d48bccc92e84 service nova] Enqueued Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 666.235425] env[65119]: INFO networking_nsxv3.common.synchronization [req-164cb8a9-762e-44ed-804f-c8563ecfa65f req-8f559d6c-6c36-42dc-8716-d48bccc92e84 service nova] Enqueued Resource ID: 31b77498-2547-49b7-b795-3c1c4171d0ef with Priority: HIGHEST for action port [ 666.235909] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_rules [ 666.236423] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 666.236637] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b77498-2547-49b7-b795-3c1c4171d0ef with Priority: HIGHEST for action port [ 666.236906] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.237265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.237265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.237474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.237613] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.238902] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.239081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.239175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.239393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.239582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.239707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.239788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.239973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.240077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.240209] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.242325] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b77498-2547-49b7-b795-3c1c4171d0ef taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.242469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.242534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.243102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.243238] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b77498-2547-49b7-b795-3c1c4171d0ef',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.342853] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.429311] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 666.429648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.429816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.430058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.430350] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.430477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.430558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.430795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.431308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.431308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.431459] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.431459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.431570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.431734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.431884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.432029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.432078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.432207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.432285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.432367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.432458] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.745602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.745812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.746106] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.747749] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31b77498-2547-49b7-b795-3c1c4171d0ef with status ACTIVE [ 666.748028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.748269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.748392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.748699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.748832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.749113] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.749265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.749374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.750736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.750870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.752460] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.752460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.752460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.752460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.752460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.752460] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31b77498-2547-49b7-b795-3c1c4171d0ef is going to be updated. [ 666.788299] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.788507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.788605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.788838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.788980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.789172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b77498-2547-49b7-b795-3c1c4171d0ef" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.845095] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.845535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.845535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.845639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.845734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.845840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 666.903052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.903215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.903288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.903513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.903660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.915854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 666.936379] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81cbcc67-f57a-4093-8432-a803e36e5a2f: rpc.has_security_group_logging(os_id): False [ 666.960862] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.961059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.961159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.961415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.996015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.996015] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.996015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.996015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.996015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.996015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.996417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.996656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.996756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.996931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.997019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.997274] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.997374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.997431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.997613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.997707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.997797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 667.079884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.080107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.080107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.080319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.080462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.095451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 667.253869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.695721] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: SUCCESS [ 667.695984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.759061] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.759264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.759328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.759521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.759628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.761227] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07660c72-b919-4d62-b37d-9ae294d80c7d is going to be created. [ 667.790360] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.790555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.790624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.790984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.791132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.810945] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: UNINITIALIZED for 2s [ 668.188530] env[65119]: INFO networking_nsxv3.common.synchronization [req-6dbc78fc-efb9-4818-84df-d06a1900b67a req-ba32f28a-593a-4015-9f37-ec2c231e7709 tempest-AttachInterfacesV270Test-1719044568 tempest-AttachInterfacesV270Test-1719044568-project-member] Enqueued Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 668.189117] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 668.189207] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.189337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.189337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.189586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.189763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.189838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.189902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.190732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.190893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.191182] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.696315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.696315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.696315] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec already deleted. [ 668.696315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.730043] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.730043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-731" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.730043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-731" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.730043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-731" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.730441] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.730737] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.730955] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.731292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.731540] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.732376] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.732376] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.732376] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.732376] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.732376] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.732826] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.733075] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.754694] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.754694] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.754694] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.754867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-731" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.755219] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-8f02ead4-bfec-490b-af44-892011c67957 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.755418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.755483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.755831] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.756148] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f02ead4-bfec-490b-af44-892011c67957',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.933097] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 668.933097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.933097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.933097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.933097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.933422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.933422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.933490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.933524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.933606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.933703] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.115898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 669.116173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.116361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.116594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.116682] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.258439] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.258702] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.258837] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.259310] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.259396] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.259601] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 8f02ead4-bfec-490b-af44-892011c67957 not found, creating... [ 669.259902] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.260097] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.260261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.260531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.260704] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.261307] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.261593] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.261789] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.262165] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.262426] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.262692] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 8f02ead4-bfec-490b-af44-892011c67957 is going to be created. [ 669.291467] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.292055] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.292203] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.292762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.292762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.293055] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.439256] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.439407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.439407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.439577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.439741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.439839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.439895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.440055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.440178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.440256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.440368] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.440459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.440521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.440843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.440843] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.441020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.441020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.441138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.441138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.441205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.441303] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.619568] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.619838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.619945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.620553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.620553] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.620834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.620834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.620951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.621343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.621478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.621578] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.824239] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: SUCCESS [ 669.824574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.824664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.824965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.825234] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.826269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.826269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.826269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.826269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.826269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.826269] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.945417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 511a8f2f-3767-4d34-9d44-c9a6cd510c1a: rpc.has_security_group_logging(os_id): False [ 669.966620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.966620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.966620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.966620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.990473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.993026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.993026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.993026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.993026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.995010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.995010] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 670.032607] env[65119]: INFO networking_nsxv3.common.synchronization [req-6dbc78fc-efb9-4818-84df-d06a1900b67a req-f5bd7fb3-ea68-4268-97b5-d8fcaa4a2ee0 service nova] Enqueued Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_rules [ 670.032725] env[65119]: INFO networking_nsxv3.common.synchronization [req-6dbc78fc-efb9-4818-84df-d06a1900b67a req-f5bd7fb3-ea68-4268-97b5-d8fcaa4a2ee0 service nova] Enqueued Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 670.032859] env[65119]: INFO networking_nsxv3.common.synchronization [req-6dbc78fc-efb9-4818-84df-d06a1900b67a req-f5bd7fb3-ea68-4268-97b5-d8fcaa4a2ee0 service nova] Enqueued Resource ID: 8f02ead4-bfec-490b-af44-892011c67957 with Priority: HIGHEST for action port [ 670.033447] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_rules [ 670.033608] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 670.033711] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f02ead4-bfec-490b-af44-892011c67957 with Priority: HIGHEST for action port [ 670.034033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.034554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.034554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.034737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.034830] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.035799] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.035972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.036099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.036380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.036618] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.036766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.036851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.036994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.037338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.037338] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.041964] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f02ead4-bfec-490b-af44-892011c67957 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.041964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.041964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.041964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.041964] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f02ead4-bfec-490b-af44-892011c67957',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.070036] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.070036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.070261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.070364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.070512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.090955] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 670.126387] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.126551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.126627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.127427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.127427] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.127427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.127427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.127730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.127730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.127730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.127870] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.127930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.127979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.128122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.128298] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.128394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.128459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.128592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.128666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.128749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.128840] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.329929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.329929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.329929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.329929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.330215] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.330215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.330215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.330370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.330441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.330528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.330675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.330787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.330859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.331659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.331659] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.331659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.331659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.331659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.332656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.332770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.332867] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.541051] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.542243] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.542243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.544816] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f02ead4-bfec-490b-af44-892011c67957 with status ACTIVE [ 670.545012] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.545126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.545193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.545434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.545597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.545809] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.545924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.545991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.546198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.546293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.546504] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.546615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.546679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.546827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.546901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.546983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f02ead4-bfec-490b-af44-892011c67957 is going to be updated. [ 670.573889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.574064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.574135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.574331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.574533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.574706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f02ead4-bfec-490b-af44-892011c67957" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.634092] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81cbcc67-f57a-4093-8432-a803e36e5a2f: rpc.has_security_group_logging(os_id): False [ 670.661683] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.661768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.661810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.662316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.662510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.662737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.662842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.662908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.663092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.663175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.663748] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.663748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.663893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.663927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.663988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.664189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.664472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.664541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.664690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.664767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.664854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 670.838503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07660c72-b919-4d62-b37d-9ae294d80c7d: rpc.has_security_group_logging(os_id): False [ 670.854739] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.854885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.854951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.855207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.855354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.872189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.872432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.872432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.872673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.872764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.872934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.873224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.873308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.873575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.873575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.873898] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.873898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.874521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.874521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.874521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.874521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.877693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.877693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.877693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.877693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.877693] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07660c72-b919-4d62-b37d-9ae294d80c7d is going to be created. [ 670.878845] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 670.969525] env[65119]: INFO networking_nsxv3.common.synchronization [None req-bd394763-c7b6-4f12-b2b7-d03f52a8c82a None None] Enqueued Resource ID: ca788b07-e623-427f-8be9-1bdd7e7ea7c2 with Priority: HIGHEST for action port [ 670.970074] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca788b07-e623-427f-8be9-1bdd7e7ea7c2 with Priority: HIGHEST for action port [ 670.970875] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca788b07-e623-427f-8be9-1bdd7e7ea7c2 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.970986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca788b07-e623-427f-8be9-1bdd7e7ea7c2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.971100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca788b07-e623-427f-8be9-1bdd7e7ea7c2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.971299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca788b07-e623-427f-8be9-1bdd7e7ea7c2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.971401] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca788b07-e623-427f-8be9-1bdd7e7ea7c2',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.999574] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.999672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.999672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.999873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.000068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.017854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: IN_PROGRESS for 2s [ 671.046618] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.473564] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca788b07-e623-427f-8be9-1bdd7e7ea7c2 [ 671.473791] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.473942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.474036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.474257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.474326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.474498] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca788b07-e623-427f-8be9-1bdd7e7ea7c2 already deleted. [ 671.474498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca788b07-e623-427f-8be9-1bdd7e7ea7c2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.550582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.550779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.550822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.551212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.551212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.551212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec is going to be created. [ 671.583914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.584111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.584176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.584385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.584565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.597412] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: UNINITIALIZED for 2s [ 672.108761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 672.109126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.905380] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 672.905380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.036805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: SUCCESS [ 673.037168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.410282] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9c6466dd-0462-42b8-979d-ca6712c7e0a1 None None] Enqueued Resource ID: a9f4882c-8d25-4c5f-b993-cc40d42e4362 with Priority: HIGHEST for action port [ 673.411903] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f4882c-8d25-4c5f-b993-cc40d42e4362 with Priority: HIGHEST for action port [ 673.412888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f4882c-8d25-4c5f-b993-cc40d42e4362 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.413051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f4882c-8d25-4c5f-b993-cc40d42e4362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.413147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f4882c-8d25-4c5f-b993-cc40d42e4362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.413590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f4882c-8d25-4c5f-b993-cc40d42e4362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.413746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f4882c-8d25-4c5f-b993-cc40d42e4362',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.615795] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: SUCCESS [ 673.616260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.616919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.616919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.617211] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.617448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.617569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.618959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.618959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.618959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.618959] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.920253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9f4882c-8d25-4c5f-b993-cc40d42e4362 [ 673.920410] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.920669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.920766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.920965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.921069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.921176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9f4882c-8d25-4c5f-b993-cc40d42e4362 already deleted. [ 673.921410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f4882c-8d25-4c5f-b993-cc40d42e4362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.121136] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.121523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.121523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.121645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.121832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.121977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.121977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.122132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.122215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.122352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.122469] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.122573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.122639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.122743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.122885] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.122978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.123051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.123530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.123530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.123530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.123530] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.628013] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec: rpc.has_security_group_logging(os_id): False [ 674.646611] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.646787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.646841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.647070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.647313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.647543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.647656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.647719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.647899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.647973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.648257] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.648353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.648407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.648577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.648656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.648852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.648946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.649017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.651872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.651964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.652070] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec is going to be created. [ 674.723979] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.724264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.724264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.724408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.724767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.738445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: IN_PROGRESS for 2s [ 675.208084] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e86518e-74fa-4d26-942f-9c55ae366b5c req-3c9a48d5-72f3-41aa-b4d9-bd1497e9988f tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 675.208975] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 675.208975] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.209434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.209434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.209434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.209640] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.209741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.209741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.209902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.209984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.210152] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.713044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.713044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.713044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.713600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.713600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.713700] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.713783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.713827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.716826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.716826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.716826] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 already deleted. [ 675.716826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.744541] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.744738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.744858] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.745241] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.745509] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.745665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.745809] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.746041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.746599] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.746876] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.747558] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.749383] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.749383] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.749383] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.749383] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.749383] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.780788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.780952] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.783024] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.783024] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.783024] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b84d2301-29b0-421f-aaff-bc52bd421828 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.783024] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.783024] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.783024] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.783024] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b84d2301-29b0-421f-aaff-bc52bd421828',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.285589] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.285894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.286092] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.286409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.286617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.287036] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b84d2301-29b0-421f-aaff-bc52bd421828 not found, creating... [ 676.287036] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.287305] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.287461] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.287625] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.287781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.288104] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.288286] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.288440] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.288636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.288791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.288931] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b84d2301-29b0-421f-aaff-bc52bd421828 is going to be created. [ 676.312269] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.312441] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.312512] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.313427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.313427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.313575] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.752757] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: SUCCESS [ 676.753088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.162978] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e86518e-74fa-4d26-942f-9c55ae366b5c req-fb4cdc99-6caf-463e-bb6a-ecc4ea7f3f99 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 677.162978] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e86518e-74fa-4d26-942f-9c55ae366b5c req-fb4cdc99-6caf-463e-bb6a-ecc4ea7f3f99 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 677.162978] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e86518e-74fa-4d26-942f-9c55ae366b5c req-fb4cdc99-6caf-463e-bb6a-ecc4ea7f3f99 service nova] Enqueued Resource ID: b84d2301-29b0-421f-aaff-bc52bd421828 with Priority: HIGHEST for action port [ 677.164247] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 677.164579] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 677.164720] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84d2301-29b0-421f-aaff-bc52bd421828 with Priority: HIGHEST for action port [ 677.165335] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.165335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.165335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.165731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.165917] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.169703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.169703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.169703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.170361] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.171692] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b84d2301-29b0-421f-aaff-bc52bd421828 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.171861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.172029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.172258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.172568] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b84d2301-29b0-421f-aaff-bc52bd421828',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.672290] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.674950] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b84d2301-29b0-421f-aaff-bc52bd421828 with status ACTIVE [ 677.675578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.675578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.675855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.675961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.676297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.676605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.676756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.676821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.677418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.677418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.677418] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.677606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.677606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.679028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.679028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.679028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b84d2301-29b0-421f-aaff-bc52bd421828 is going to be updated. [ 677.680773] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.681352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.711840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.711840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.711840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.711840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.712305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.712305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b84d2301-29b0-421f-aaff-bc52bd421828" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.062609] env[65119]: INFO networking_nsxv3.common.synchronization [req-086499ee-132f-4a13-8c70-e1bef1e567be req-7c497ad8-4157-404c-bc8b-fdf961f8e9e7 tempest-TenantUsagesTestJSON-1001019170 tempest-TenantUsagesTestJSON-1001019170-project-member] Enqueued Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 678.063203] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 678.063518] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.063709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.063709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.063954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.067678] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.067850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.067920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.068123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.068238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.068339] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.182277] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.573492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.574581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.574581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.575754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.575754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.575890] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.575999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.576077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.576363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.576363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.576501] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 already deleted. [ 678.576560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.642798] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.643064] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.643457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.643643] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.643783] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.643949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.644076] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.644315] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.644435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.645098] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.645258] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.645399] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.645533] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.645714] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.645837] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.646044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.668417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.668649] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.668803] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.669366] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.669652] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-de22227e-7ac6-4458-aac3-7414d419ffde taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.669652] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.669774] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.670237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.670237] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de22227e-7ac6-4458-aac3-7414d419ffde',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.689481] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.689481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.689481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.689481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.689481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.689481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be created. [ 678.713604] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.713604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.713797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.714026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.714177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.724548] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: UNINITIALIZED for 2s [ 679.174048] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.174486] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.174486] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.174567] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.174683] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.176044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port de22227e-7ac6-4458-aac3-7414d419ffde not found, creating... [ 679.176044] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.176044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.176044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.176044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.176044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.176402] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.176402] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.176564] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.176738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.176869] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.177022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: de22227e-7ac6-4458-aac3-7414d419ffde is going to be created. [ 679.199134] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.199343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.199468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.200679] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.200679] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.200679] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.961486] env[65119]: INFO networking_nsxv3.common.synchronization [req-086499ee-132f-4a13-8c70-e1bef1e567be req-3d81d3f3-3606-49ab-b45d-9f4a652d6eff service nova] Enqueued Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_rules [ 679.961486] env[65119]: INFO networking_nsxv3.common.synchronization [req-086499ee-132f-4a13-8c70-e1bef1e567be req-3d81d3f3-3606-49ab-b45d-9f4a652d6eff service nova] Enqueued Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 679.961486] env[65119]: INFO networking_nsxv3.common.synchronization [req-086499ee-132f-4a13-8c70-e1bef1e567be req-3d81d3f3-3606-49ab-b45d-9f4a652d6eff service nova] Enqueued Resource ID: de22227e-7ac6-4458-aac3-7414d419ffde with Priority: HIGHEST for action port [ 679.961486] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_rules [ 679.961486] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 679.962687] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de22227e-7ac6-4458-aac3-7414d419ffde with Priority: HIGHEST for action port [ 679.962687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.962687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.962979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.963230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.963542] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.966199] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.967064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.967261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.967508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.967713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.967852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.967935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.968144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.970350] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.971601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-de22227e-7ac6-4458-aac3-7414d419ffde taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.971601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.971601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.971891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.971891] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de22227e-7ac6-4458-aac3-7414d419ffde',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.473592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.474299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.474541] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.475707] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de22227e-7ac6-4458-aac3-7414d419ffde with status ACTIVE [ 680.475899] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.476027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.476091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.476312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.476411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.476602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.476699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.476753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.476898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.476969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.477198] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.477329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.477392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.477607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.477713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.477843] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de22227e-7ac6-4458-aac3-7414d419ffde is going to be updated. [ 680.504698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.504698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.504698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.504869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.504910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.505126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de22227e-7ac6-4458-aac3-7414d419ffde" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.642139] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43448b15-b23b-4510-8a3f-7fa6509764cf None None] Enqueued Resource ID: 7a4ab969-247c-4c93-b80f-643433decec2 with Priority: HIGHEST for action port [ 680.644120] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4ab969-247c-4c93-b80f-643433decec2 with Priority: HIGHEST for action port [ 680.644673] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a4ab969-247c-4c93-b80f-643433decec2 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.644673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a4ab969-247c-4c93-b80f-643433decec2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.644673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a4ab969-247c-4c93-b80f-643433decec2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.644895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a4ab969-247c-4c93-b80f-643433decec2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.644895] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a4ab969-247c-4c93-b80f-643433decec2',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.736384] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 680.737429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.738017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.738760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.738760] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.739440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.739530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.739711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.739796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.739884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.739976] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.980277] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.149073] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a4ab969-247c-4c93-b80f-643433decec2 [ 681.149339] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.149833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.149833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.149833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.149833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.151486] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a4ab969-247c-4c93-b80f-643433decec2 already deleted. [ 681.151647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a4ab969-247c-4c93-b80f-643433decec2" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.243873] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.243873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.243873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.244170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.244170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.244287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.244336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.244751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.244751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.244751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.244751] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.245987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.245987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.245987] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.484587] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.485262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.485262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.485262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.485462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.485462] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 is going to be created. [ 681.514190] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.514190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.514190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.514190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.514190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.531891] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: UNINITIALIZED for 2s [ 681.749444] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4688087-743d-4d09-ac40-3272e1f90bc5: rpc.has_security_group_logging(os_id): False [ 681.767147] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.767407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.767480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.767699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.767798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.767989] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.768169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.768235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.768532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.768666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.768920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.769043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.769152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.769336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.769433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.769688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.769799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.769872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.770061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.770174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.770276] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be created. [ 681.797796] env[65119]: INFO networking_nsxv3.common.synchronization [req-460d0f0d-def5-4807-b677-0566f1219c03 req-5cfdad21-0176-4c01-8d0f-6214b216d264 tempest-DeleteServersAdminTestJSON-506825564 tempest-DeleteServersAdminTestJSON-506825564-project-member] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 681.799079] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGHEST for action security_group_members [ 681.801745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.801745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.801745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.801745] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.879026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.879205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.879287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.879736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.879997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.897378] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 682.134360] env[65119]: INFO networking_nsxv3.common.synchronization [req-fa9aed45-532f-44e4-abe2-4234af417553 req-3e51fae8-e2d3-48f4-8f8d-10a513e9591f tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 682.135513] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 682.135656] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.137294] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.137294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.137294] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.304812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.304969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.305036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.305268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.305847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.305847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.305847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.305847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.305847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.306193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.306193] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be updated. [ 682.344018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.344018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.344018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.344018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.344018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.379675] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: IN_PROGRESS for 2s [ 682.584071] env[65119]: INFO networking_nsxv3.common.synchronization [req-8a6f1e79-0bb4-4efb-ac13-e12837384352 req-70ef03b1-8671-42ba-8f17-b017e9001cb9 tempest-ServerRescueTestJSONUnderV235-645439141 tempest-ServerRescueTestJSONUnderV235-645439141-project-member] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 682.584071] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGHEST for action security_group_members [ 682.584071] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.584581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.584581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.584581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.584785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.584921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.584921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.585088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.585182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.585298] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.639085] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.664311] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.664505] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.664626] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.664879] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.665199] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.665469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.665589] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.665822] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.666122] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.666468] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.666529] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.666600] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.666719] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.666861] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.666969] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.667115] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.692974] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.693228] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.693475] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.693689] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.694010] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-e324a195-9705-4f74-9323-4584ac8d2d5c taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.694293] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.694423] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.694732] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.694870] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e324a195-9705-4f74-9323-4584ac8d2d5c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.089406] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.089665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.089837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.090012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.090123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.090372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.090513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.090513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.090672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.090744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.090934] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be updated. [ 683.131021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.131154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.131221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.132586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.132586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.142058] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b09835af-f63f-4730-9701-c941fd8a7067 None None] Enqueued Resource ID: 1fa6be6f-91e3-4261-a063-0719e10c840c with Priority: HIGHEST for action port [ 683.142688] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fa6be6f-91e3-4261-a063-0719e10c840c with Priority: HIGHEST for action port [ 683.143473] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fa6be6f-91e3-4261-a063-0719e10c840c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.143668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fa6be6f-91e3-4261-a063-0719e10c840c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.143759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fa6be6f-91e3-4261-a063-0719e10c840c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.144064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fa6be6f-91e3-4261-a063-0719e10c840c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.144219] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa6be6f-91e3-4261-a063-0719e10c840c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.145794] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: IN_PROGRESS for 2s [ 683.146064] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.198015] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199402] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.200480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.202676] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.202840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port e324a195-9705-4f74-9323-4584ac8d2d5c not found, creating... [ 683.203191] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.203372] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.203514] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.203777] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.203931] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.205805] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.207164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.207373] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.207648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.207795] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.207962] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: e324a195-9705-4f74-9323-4584ac8d2d5c is going to be created. [ 683.243867] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.243867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.243867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.243867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.243867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.243867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.544458] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: SUCCESS [ 683.544714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.544898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.545134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.545331] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.545454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.545521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.545672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.545755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.545842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.545933] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.649035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fa6be6f-91e3-4261-a063-0719e10c840c [ 683.649375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.649375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.649375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.649740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.649740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.649740] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fa6be6f-91e3-4261-a063-0719e10c840c already deleted. [ 683.649929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fa6be6f-91e3-4261-a063-0719e10c840c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.650134] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.650249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.650303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.650445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.650520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.650603] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 683.686878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.687032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.687106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.687348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.687503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.697992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 683.917633] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 683.917633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.010392] env[65119]: INFO networking_nsxv3.common.synchronization [req-fa9aed45-532f-44e4-abe2-4234af417553 req-0f6cd221-252a-4318-bc9d-5923fe3c24ed service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 684.010392] env[65119]: INFO networking_nsxv3.common.synchronization [req-fa9aed45-532f-44e4-abe2-4234af417553 req-0f6cd221-252a-4318-bc9d-5923fe3c24ed service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 684.010392] env[65119]: INFO networking_nsxv3.common.synchronization [req-fa9aed45-532f-44e4-abe2-4234af417553 req-0f6cd221-252a-4318-bc9d-5923fe3c24ed service nova] Enqueued Resource ID: e324a195-9705-4f74-9323-4584ac8d2d5c with Priority: HIGHEST for action port [ 684.010392] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 684.010392] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 684.010596] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e324a195-9705-4f74-9323-4584ac8d2d5c with Priority: HIGHEST for action port [ 684.010769] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.010891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.010957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.011189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.011340] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.012230] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.012336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.012545] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e324a195-9705-4f74-9323-4584ac8d2d5c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.012657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.012723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.012999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.013092] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e324a195-9705-4f74-9323-4584ac8d2d5c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.047806] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.049671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.049671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.049671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.049671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.050223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.050223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.050223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.050223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.050223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.050223] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.391404] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 in Status: SUCCESS [ 684.391404] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 deletion is rescheduled due to dependency. [ 684.391404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.515320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.515577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516324] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e324a195-9705-4f74-9323-4584ac8d2d5c with status ACTIVE [ 684.516324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.516324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.517796] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.517796] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.519703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.519703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.519703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.519703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.519703] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e324a195-9705-4f74-9323-4584ac8d2d5c is going to be updated. [ 684.549749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.549933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.549996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.550245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.550382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.551091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e324a195-9705-4f74-9323-4584ac8d2d5c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.556281] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9: rpc.has_security_group_logging(os_id): False [ 684.579371] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.579521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.579568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.579809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.579956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.580193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.580303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.580374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.580687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.580687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.580940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.581030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.586138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.586138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.586138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.586138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.586138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.586138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.586463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.586463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.586610] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 is going to be created. [ 684.674998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.675862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.675862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.675862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.675862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.690293] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: IN_PROGRESS for 2s [ 685.159998] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f in Status: SUCCESS [ 685.160774] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f deletion is rescheduled due to dependency. [ 685.160774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.712105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 685.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.713211] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.714037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.714037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.714037] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.101984] env[65119]: INFO networking_nsxv3.common.synchronization [None req-da59c8c7-33af-4c76-94f4-ab0c93c4aaef None None] Enqueued Resource ID: 3554756b-b5b8-4062-905e-bc017f4277a4 with Priority: HIGHEST for action port [ 686.102438] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3554756b-b5b8-4062-905e-bc017f4277a4 with Priority: HIGHEST for action port [ 686.102775] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-3554756b-b5b8-4062-905e-bc017f4277a4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.102908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3554756b-b5b8-4062-905e-bc017f4277a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.102993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3554756b-b5b8-4062-905e-bc017f4277a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.103381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3554756b-b5b8-4062-905e-bc017f4277a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.103583] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3554756b-b5b8-4062-905e-bc017f4277a4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.220417] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.353967] env[65119]: INFO networking_nsxv3.common.synchronization [None req-757a8431-ba6f-4e27-9d83-0117bbb537ee None None] Enqueued Resource ID: 8edad5b1-fd30-4f70-8822-04fcb9496cea with Priority: HIGHEST for action port [ 686.353967] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8edad5b1-fd30-4f70-8822-04fcb9496cea with Priority: HIGHEST for action port [ 686.353967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8edad5b1-fd30-4f70-8822-04fcb9496cea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.353967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8edad5b1-fd30-4f70-8822-04fcb9496cea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.353967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8edad5b1-fd30-4f70-8822-04fcb9496cea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.353967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8edad5b1-fd30-4f70-8822-04fcb9496cea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.353967] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8edad5b1-fd30-4f70-8822-04fcb9496cea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.605661] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3554756b-b5b8-4062-905e-bc017f4277a4 [ 686.605977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.606287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.606401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.606660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.606783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.606923] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3554756b-b5b8-4062-905e-bc017f4277a4 already deleted. [ 686.607046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3554756b-b5b8-4062-905e-bc017f4277a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.708792] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: SUCCESS [ 686.708792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.723576] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.857057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8edad5b1-fd30-4f70-8822-04fcb9496cea [ 686.857057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.857057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.857057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.857057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.857057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.857057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8edad5b1-fd30-4f70-8822-04fcb9496cea already deleted. [ 686.857057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8edad5b1-fd30-4f70-8822-04fcb9496cea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154415] env[65119]: INFO networking_nsxv3.common.synchronization [req-48f3f02e-512b-4c69-86b8-48fdf3de3c10 req-781ec78f-83bc-4635-854b-383538e079c3 tempest-VolumesAdminNegativeTest-2052342638 tempest-VolumesAdminNegativeTest-2052342638-project-member] Enqueued Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 687.154611] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGHEST for action security_group_members [ 687.154947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.155671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.155775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.155986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.156166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.156271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.156333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.156486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.156574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.156670] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.226319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.226488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.226562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.226792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.226885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.226984] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 687.266557] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.266557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.266557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.266557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.266557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.281586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 687.659434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.659434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.659434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.659434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.659434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.659434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.660634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.660634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.660634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.660634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.660634] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 is going to be updated. [ 687.693014] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.693235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.693291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.693529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.693683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.707082] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: IN_PROGRESS for 2s [ 688.963088] env[65119]: INFO networking_nsxv3.common.synchronization [None req-922222f4-004e-46a4-84c4-bec816527f65 None None] Enqueued Resource ID: 881ec708-c2a1-404d-bd5f-edaf0aad3ec9 with Priority: HIGHEST for action port [ 688.963665] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881ec708-c2a1-404d-bd5f-edaf0aad3ec9 with Priority: HIGHEST for action port [ 688.963977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-881ec708-c2a1-404d-bd5f-edaf0aad3ec9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.965226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-881ec708-c2a1-404d-bd5f-edaf0aad3ec9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.966678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-881ec708-c2a1-404d-bd5f-edaf0aad3ec9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.966678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-881ec708-c2a1-404d-bd5f-edaf0aad3ec9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.966678] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881ec708-c2a1-404d-bd5f-edaf0aad3ec9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.295789] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 689.295956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.296091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.297693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.297693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.297693] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.470217] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 881ec708-c2a1-404d-bd5f-edaf0aad3ec9 [ 689.470500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.470774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.470774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.471209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.471209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.471209] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:881ec708-c2a1-404d-bd5f-edaf0aad3ec9 already deleted. [ 689.471209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-881ec708-c2a1-404d-bd5f-edaf0aad3ec9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.718050] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 in Status: SUCCESS [ 689.718265] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 deletion is rescheduled due to dependency. [ 689.718341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.815480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.815480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.815480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.815480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.815480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.818407] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.818407] env[65119]: INFO networking_nsxv3.common.synchronization [None req-60774d2b-f8cd-4752-82b1-22de9f708bf5 None None] Enqueued Resource ID: 9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab with Priority: HIGHEST for action port [ 689.818407] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab with Priority: HIGHEST for action port [ 689.818407] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.818407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.818407] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.307703] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4688087-743d-4d09-ac40-3272e1f90bc5: rpc.has_security_group_logging(os_id): False [ 690.313739] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab [ 690.314837] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.314837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.314837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.315401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.315434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.315538] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab already deleted. [ 690.315641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a7bc5d6-a03d-49eb-b721-1f8c6b1925ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.329746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.329862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.329934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.330573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.330686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.330963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.331126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.331309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.331418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.331698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.331878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.331998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.332486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.332683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.332809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.333073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.333200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.333557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.333740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.333823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.333927] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 690.418878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.418878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.418878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.418878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.418878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438998] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 692.342044] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43b7d94b-dd51-4acb-93a3-452feee7a1af None None] Enqueued Resource ID: 53a9b1bd-5848-4656-9da1-b82fefc9a723 with Priority: HIGHEST for action port [ 692.343023] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a9b1bd-5848-4656-9da1-b82fefc9a723 with Priority: HIGHEST for action port [ 692.348221] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-53a9b1bd-5848-4656-9da1-b82fefc9a723 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.348398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53a9b1bd-5848-4656-9da1-b82fefc9a723" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.348478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53a9b1bd-5848-4656-9da1-b82fefc9a723" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.348797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53a9b1bd-5848-4656-9da1-b82fefc9a723" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.348797] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53a9b1bd-5848-4656-9da1-b82fefc9a723',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.457809] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 692.458296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.852063] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53a9b1bd-5848-4656-9da1-b82fefc9a723 [ 692.852738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.853768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.853768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.853768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.853768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.853768] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53a9b1bd-5848-4656-9da1-b82fefc9a723 already deleted. [ 692.853768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53a9b1bd-5848-4656-9da1-b82fefc9a723" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.108145] env[65119]: INFO networking_nsxv3.common.synchronization [req-1df9e356-f635-42ad-89da-356be7782a72 req-97141b28-d344-444b-9497-421e322ee9ba tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 694.109085] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 694.113594] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.115508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.115508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.115640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.116013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.116537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.116537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.117184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.117443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.119176] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.622929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.623876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.623876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.623876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.652114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.652401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.652526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.654586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.654586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.654586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.654586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 694.681338] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.682421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.682421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.682682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.684219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.695173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 695.025428] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1ea5d509-c354-4f45-9e05-46966087ba81 None None] Enqueued Resource ID: 61f4415d-37a5-413d-b908-4540a1508316 with Priority: HIGHEST for action port [ 695.026062] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61f4415d-37a5-413d-b908-4540a1508316 with Priority: HIGHEST for action port [ 695.026365] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-61f4415d-37a5-413d-b908-4540a1508316 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.026504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61f4415d-37a5-413d-b908-4540a1508316" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.026537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61f4415d-37a5-413d-b908-4540a1508316" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.026834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61f4415d-37a5-413d-b908-4540a1508316" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.026916] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61f4415d-37a5-413d-b908-4540a1508316',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.530371] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61f4415d-37a5-413d-b908-4540a1508316 [ 695.530695] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.531276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.531400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.532176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.532176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.532176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61f4415d-37a5-413d-b908-4540a1508316 already deleted. [ 695.532176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61f4415d-37a5-413d-b908-4540a1508316" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.644139] env[65119]: INFO networking_nsxv3.common.synchronization [req-263e8a42-2a50-4d2f-8e5f-b928ce1ec8e0 req-623d3fa7-69a3-464a-b69e-c8741c9091b0 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 696.644679] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 696.644986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.645127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.645197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.646101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.646287] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.646402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.646471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.646647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.646758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.646837] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.708537] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 696.708537] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 696.708537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.820596] env[65119]: INFO networking_nsxv3.common.synchronization [None req-fb76b0e5-5c91-40d9-be31-76826305fd52 tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 14926d88-615a-4da4-9209-56a0a3001f8e with Priority: HIGHEST for action security_group_rules [ 696.821431] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14926d88-615a-4da4-9209-56a0a3001f8e with Priority: HIGHEST for action security_group_rules [ 696.821495] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14926d88-615a-4da4-9209-56a0a3001f8e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.821595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.821694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.821910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.822045] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14926d88-615a-4da4-9209-56a0a3001f8e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.975873] env[65119]: INFO networking_nsxv3.common.synchronization [None req-02213a09-de6f-41da-84ff-51aab0cfccc9 tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 14926d88-615a-4da4-9209-56a0a3001f8e with Priority: HIGHEST for action security_group_rules [ 696.976820] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14926d88-615a-4da4-9209-56a0a3001f8e with Priority: HIGHEST for action security_group_rules [ 696.979142] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14926d88-615a-4da4-9209-56a0a3001f8e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.979142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.136775] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.136985] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.137199] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.137638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.137908] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.138082] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.138193] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.138514] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.138691] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.138933] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.139187] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.139187] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.139300] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.139360] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.139482] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.139617] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.149712] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.149958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.150048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.150318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.150487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.150765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.151409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.151409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.151409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.151409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.151581] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 already deleted. [ 697.151581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.163401] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.163488] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.163612] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.163784] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.164114] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-408fa504-a4e9-4037-a8ee-cba10a6b6b69 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.164304] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.164450] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.164819] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.167380] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('408fa504-a4e9-4037-a8ee-cba10a6b6b69',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.343530] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.343686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.343753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.343993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.344139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.344240] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14926d88-615a-4da4-9209-56a0a3001f8e already deleted. [ 697.345226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.345226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.345226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.345226] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14926d88-615a-4da4-9209-56a0a3001f8e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.671361] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.671361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 408fa504-a4e9-4037-a8ee-cba10a6b6b69 not found, creating... [ 697.671361] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.671361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.671920] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.671920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.671920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.671920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.671920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.671920] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 408fa504-a4e9-4037-a8ee-cba10a6b6b69 is going to be created. [ 697.705651] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.706080] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.706247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.709797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.709797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.709797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.878330] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.878604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.878708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.878976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.879102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.879228] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14926d88-615a-4da4-9209-56a0a3001f8e already deleted. [ 697.879442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14926d88-615a-4da4-9209-56a0a3001f8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.919924] env[65119]: INFO networking_nsxv3.common.synchronization [req-fc6ac7db-ca09-4489-a669-11eb3ce68921 req-9e9baa0d-273e-40bb-864c-62fc91c261b3 tempest-AttachInterfacesV270Test-1719044568 tempest-AttachInterfacesV270Test-1719044568-project-member] Enqueued Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 697.920697] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGHEST for action security_group_members [ 697.921112] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.921280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.921386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.921605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.921803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.921928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.922044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.922245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.922359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.922487] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.426390] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.426559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.426720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.427096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.427251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.427544] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.427679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.427747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.427921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.428011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.428359] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec is going to be updated. [ 698.460247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.460247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.460247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.460247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.460247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.471157] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: IN_PROGRESS for 2s [ 698.496123] env[65119]: INFO networking_nsxv3.common.synchronization [req-263e8a42-2a50-4d2f-8e5f-b928ce1ec8e0 req-3ca12438-ba1c-4631-bfbe-3c8a8ea14aa4 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 698.496315] env[65119]: INFO networking_nsxv3.common.synchronization [req-263e8a42-2a50-4d2f-8e5f-b928ce1ec8e0 req-3ca12438-ba1c-4631-bfbe-3c8a8ea14aa4 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 698.496385] env[65119]: INFO networking_nsxv3.common.synchronization [req-263e8a42-2a50-4d2f-8e5f-b928ce1ec8e0 req-3ca12438-ba1c-4631-bfbe-3c8a8ea14aa4 service nova] Enqueued Resource ID: 408fa504-a4e9-4037-a8ee-cba10a6b6b69 with Priority: HIGHEST for action port [ 698.496912] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 698.497578] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 698.497578] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 408fa504-a4e9-4037-a8ee-cba10a6b6b69 with Priority: HIGHEST for action port [ 698.497578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.497744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.497744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.497938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.498078] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.499226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.499311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.499380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.499546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.499713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.499808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.499895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.500231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.500231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.500231] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.501823] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-408fa504-a4e9-4037-a8ee-cba10a6b6b69 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.502658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.502755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.503165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.503165] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('408fa504-a4e9-4037-a8ee-cba10a6b6b69',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.004447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.004835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.004835] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.011084] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 408fa504-a4e9-4037-a8ee-cba10a6b6b69 with status ACTIVE [ 699.011084] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.011263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.011263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.011410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.011497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.015026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.015026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.015026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.015026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 408fa504-a4e9-4037-a8ee-cba10a6b6b69 is going to be updated. [ 699.036684] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.036870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.036957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.037195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.037446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.037661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-408fa504-a4e9-4037-a8ee-cba10a6b6b69" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.274647] env[65119]: INFO networking_nsxv3.common.synchronization [req-2fd05851-0287-4490-b2db-fba02bc98569 req-e9169ed6-7f52-4d82-a20a-97a4c6bdf5d0 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 699.275298] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 699.275834] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.275834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.275977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.276176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.276401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.276561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.276730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.276890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.277029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.277132] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.508656] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.698509] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-358 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.698770] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.698916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.699222] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.699591] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.699823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.699975] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.701021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.701204] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.701446] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.701861] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.702244] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.702717] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.702879] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.703430] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.703639] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.725668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.725878] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.725975] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.726169] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.726483] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.726664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.726757] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.727125] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.727246] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.780037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.780204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.780276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.780481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.780570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.780757] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.780866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.780897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.781052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.781124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.781206] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 699.805856] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.806429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.806429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.806429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.806429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.817312] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 700.013156] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.013156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.013156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.013540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.013540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.013617] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be created. [ 700.043534] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.043534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.043534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.043534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.043534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.054869] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: UNINITIALIZED for 2s [ 700.233051] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.233051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.233051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.233359] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.233472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.233816] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 not found, creating... [ 700.234059] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.234337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.234337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.234565] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.234701] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.235034] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.235219] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.235353] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.235621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.235770] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.235926] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 is going to be created. [ 700.266269] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.266638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.266784] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.267223] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.267493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.268225] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.482977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec in Status: SUCCESS [ 700.483199] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec deletion is rescheduled due to dependency. [ 700.483312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.092676] env[65119]: INFO networking_nsxv3.common.synchronization [req-2fd05851-0287-4490-b2db-fba02bc98569 req-19d79390-6a5c-4dc9-9dd1-15f9bc4dead8 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 701.092676] env[65119]: INFO networking_nsxv3.common.synchronization [req-2fd05851-0287-4490-b2db-fba02bc98569 req-19d79390-6a5c-4dc9-9dd1-15f9bc4dead8 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 701.092676] env[65119]: INFO networking_nsxv3.common.synchronization [req-2fd05851-0287-4490-b2db-fba02bc98569 req-19d79390-6a5c-4dc9-9dd1-15f9bc4dead8 service nova] Enqueued Resource ID: 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 with Priority: HIGHEST for action port [ 701.092972] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 701.092972] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 701.093618] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 with Priority: HIGHEST for action port [ 701.095039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.095197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.095568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.095767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.096343] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.099882] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.099882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.101722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.101935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.102127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.102490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.102658] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.600549] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.600737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.607533] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 with status ACTIVE [ 701.608014] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.608519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.608591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.608873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.608994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.609234] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.609342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.609454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.609607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.609692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.609887] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.610137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.610137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.610215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.610294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.611033] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31 is going to be updated. [ 701.635998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.636657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.636657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.636831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.637192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.637192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ed7e7ef-1349-42b3-9e0d-c9f405b0ef31" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.831695] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 701.831948] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 701.832078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.832266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.832498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.832682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.832788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.832864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.833203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.833306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.834089] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.044082] env[65119]: INFO networking_nsxv3.common.synchronization [req-4427ac6a-94c6-4697-a3b5-4038750736ad req-c2caf159-3dcb-493d-bfbe-fa86dfc854d8 tempest-ServerMetadataTestJSON-45433866 tempest-ServerMetadataTestJSON-45433866-project-member] Enqueued Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 702.044847] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 702.045842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.046014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.046094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.046348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.046511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.046825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.046825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.046825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.046979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.047033] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.066609] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 702.066833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.067262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.067583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.067791] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.067944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.068070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.068305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.068451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.068585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.068686] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.336401] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.466401] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.466604] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-794" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.466772] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-794" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.468291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-794" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.468291] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.468291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.468291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.468558] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.468894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.468945] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.470268] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.470453] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.470578] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.470773] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.470892] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.471069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.513090] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.513268] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.513407] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.513600] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-794" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.513999] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.514152] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.514207] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.514522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.514649] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dab8878-e6a8-45d3-a7e2-2417d8c3cd44',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.549721] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.550035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.550186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.550800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.551057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.551394] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.551714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.552068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.552380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.552518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.552676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 already deleted. [ 702.552835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.563926] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de0bed8-16b0-487b-9c00-65d5ff2adc9e req-6c6e51f2-8c4c-4f38-bfc9-a97a07fe0a58 tempest-TenantUsagesTestJSON-1001019170 tempest-TenantUsagesTestJSON-1001019170-project-member] Enqueued Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 702.564503] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGHEST for action security_group_members [ 702.564818] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.564939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.565015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.565219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.565378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.565476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.565537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.565918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.565918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.565918] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.570461] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.570596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.570667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.570849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.571062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.571188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.571234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.571401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.571488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.571548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.571690] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.571782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.571842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.571986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.572624] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.572787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.572859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.573018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.573105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.573191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.573282] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.841721] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.019637] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.019870] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.019992] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020286] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020628] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 not found, creating... [ 703.020917] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.021091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.021205] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.021428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.021607] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.022687] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.024178] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.024363] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.024646] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.025182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.025182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 is going to be created. [ 703.050036] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.050746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.050746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.050746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.051023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.051173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.067995] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.068218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.068326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.068557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.068654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.068850] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.068966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.069021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.069175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.069251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.069502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 is going to be updated. [ 703.074835] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 703.099837] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.099983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.100074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.100311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.100389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.101474] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.101775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.101904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.103386] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.103386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.103595] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.103595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.103679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.103887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.103994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.104134] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be created. [ 703.135436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.135683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.135759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.136013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.136171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.154205] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: IN_PROGRESS for 2s [ 703.242933] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.243168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.243245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.243394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.244920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.264508] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 703.345342] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.345993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.345993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.345993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.345993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.345993] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 703.405801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.405998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.406073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.406271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.406430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.415957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 703.788706] env[65119]: INFO networking_nsxv3.common.synchronization [req-4427ac6a-94c6-4697-a3b5-4038750736ad req-3c3a5fa0-9c4e-4718-bd6a-2e8cd1f8cfa1 service nova] Enqueued Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_rules [ 703.788706] env[65119]: INFO networking_nsxv3.common.synchronization [req-4427ac6a-94c6-4697-a3b5-4038750736ad req-3c3a5fa0-9c4e-4718-bd6a-2e8cd1f8cfa1 service nova] Enqueued Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 703.788983] env[65119]: INFO networking_nsxv3.common.synchronization [req-4427ac6a-94c6-4697-a3b5-4038750736ad req-3c3a5fa0-9c4e-4718-bd6a-2e8cd1f8cfa1 service nova] Enqueued Resource ID: 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 with Priority: HIGHEST for action port [ 703.789920] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_rules [ 703.789920] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 703.792073] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 with Priority: HIGHEST for action port [ 703.792073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.792242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.792333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.792894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.793071] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.795548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.795754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.795852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.796113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.796293] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.796376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.796438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.798045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.798045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.798045] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.798045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.798355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.798540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.798626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.798678] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dab8878-e6a8-45d3-a7e2-2417d8c3cd44',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.266125] env[65119]: INFO networking_nsxv3.common.synchronization [req-bd55b5c3-aab3-42eb-8a9d-a70735c35e6e req-bcdf0e23-b3e3-4056-918a-9f3a51d80a8b tempest-ServersTestBootFromVolume-80384451 tempest-ServersTestBootFromVolume-80384451-project-member] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 704.266502] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGHEST for action security_group_members [ 704.267150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.269914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.269914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.269914] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.284343] env[65119]: INFO networking_nsxv3.common.synchronization [None req-13f2ad06-efd5-4341-b45c-76c7b59591ed None None] Enqueued Resource ID: a8ee2de2-ab75-47dd-8aff-2e84ee62b725 with Priority: HIGHEST for action port [ 704.287505] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ee2de2-ab75-47dd-8aff-2e84ee62b725 with Priority: HIGHEST for action port [ 704.287998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8ee2de2-ab75-47dd-8aff-2e84ee62b725 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.288715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8ee2de2-ab75-47dd-8aff-2e84ee62b725" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.288715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8ee2de2-ab75-47dd-8aff-2e84ee62b725" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.288715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8ee2de2-ab75-47dd-8aff-2e84ee62b725" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.288975] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ee2de2-ab75-47dd-8aff-2e84ee62b725',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.301367] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.303402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.303402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.303402] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 with status ACTIVE [ 704.303402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.303402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.303402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.303786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.303786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.303786] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.303935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.303935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.304180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.304814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.304881] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.305026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.305089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.305862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.305946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.306136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dab8878-e6a8-45d3-a7e2-2417d8c3cd44 is going to be updated. [ 704.335749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.335942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.335985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.336582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.336582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.336971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dab8878-e6a8-45d3-a7e2-2417d8c3cd44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.776580] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.776899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.776899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.777080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.793399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8ee2de2-ab75-47dd-8aff-2e84ee62b725 [ 704.793399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.793399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.793399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.793399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.793399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.793399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8ee2de2-ab75-47dd-8aff-2e84ee62b725 already deleted. [ 704.793399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8ee2de2-ab75-47dd-8aff-2e84ee62b725" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.802156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.802419] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.802546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.802611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.802798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.802882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.802970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 is going to be updated. [ 704.808481] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.840051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.841849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.841849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.842674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.842863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.873460] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: IN_PROGRESS for 2s [ 705.168508] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 in Status: SUCCESS [ 705.168910] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 deletion is rescheduled due to dependency. [ 705.169174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.283874] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 705.283874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.311671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.311925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.312033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.312298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.314545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.314545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 is going to be created. [ 705.346460] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.346675] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.346818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.347084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.347627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.365174] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: UNINITIALIZED for 2s [ 705.427999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 705.427999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.427999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.427999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.428321] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.428321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.428545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.428719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.428804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.428894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.428987] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.932353] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.932731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.932731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.932837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.932998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.933113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.933177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.933370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.933422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.933497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.933704] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.933746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.933790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.934414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.934414] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.934414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.934414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.934414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.934414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.934676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.934676] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.439024] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a32e7cc-5871-4cac-93b4-13eb1e04d001: rpc.has_security_group_logging(os_id): False [ 706.464081] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.464081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.464081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.464081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.464081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.464081] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.464477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.464477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.465119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.465119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.465119] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.465119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.465119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.465358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.465585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.466128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.466128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.466128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.466128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.466301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.466387] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 706.554538] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.554538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.554538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.554538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.554538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.569384] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 706.886540] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 in Status: SUCCESS [ 706.887055] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 deletion is rescheduled due to dependency. [ 706.887589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.283470] env[65119]: INFO networking_nsxv3.common.synchronization [None req-52d7eb34-8ee7-4143-b2fa-c1e4afdfdba9 None None] Enqueued Resource ID: e90ed2b1-e476-4b5b-bd60-e883d37ebd2b with Priority: HIGHEST for action port [ 707.284111] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90ed2b1-e476-4b5b-bd60-e883d37ebd2b with Priority: HIGHEST for action port [ 707.284449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90ed2b1-e476-4b5b-bd60-e883d37ebd2b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.284635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90ed2b1-e476-4b5b-bd60-e883d37ebd2b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.284692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90ed2b1-e476-4b5b-bd60-e883d37ebd2b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.284944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90ed2b1-e476-4b5b-bd60-e883d37ebd2b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.285663] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90ed2b1-e476-4b5b-bd60-e883d37ebd2b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.378271] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: SUCCESS [ 707.378271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.378271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.378271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.378271] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.378271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.378271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.378502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.378502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.379801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.379801] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.788955] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e90ed2b1-e476-4b5b-bd60-e883d37ebd2b [ 707.789438] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.789955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.790071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.790284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.790376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.790480] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e90ed2b1-e476-4b5b-bd60-e883d37ebd2b already deleted. [ 707.790569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90ed2b1-e476-4b5b-bd60-e883d37ebd2b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.801361] env[65119]: INFO networking_nsxv3.common.synchronization [req-2c5964a0-a596-4927-9264-9af3530a1dda req-5c62a526-b1ad-4b5d-a416-c1bebd3c0403 tempest-VolumesAssistedSnapshotsTest-1186702850 tempest-VolumesAssistedSnapshotsTest-1186702850-project-member] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 707.802208] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGHEST for action security_group_members [ 707.802779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.802935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.803019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.803611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.803828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.803971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.804081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.804314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.804428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.804577] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.886950] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.887156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.887230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.887412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.887640] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.887742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.887804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.887954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.888066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.888152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.888816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.888816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.888816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.888816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.888816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.889162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.889162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.889162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.889162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.889351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.889399] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.307583] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.308236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.308319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.308637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.340222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.340508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.340666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.340714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.341285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.341285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.341285] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 is going to be updated. [ 708.378487] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.378487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.378642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.378865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.379030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.390086] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: IN_PROGRESS for 2s [ 708.391730] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dd81141-ab63-45d1-8370-e285d4f0dfa9: rpc.has_security_group_logging(os_id): False [ 708.413146] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.413146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.413570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.413570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.413701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.413900] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.414070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.414151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.414655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.414655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.414808] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.414808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.414919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.415782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.417683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.417683] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.417683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.417683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.417683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.417683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.417683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 is going to be created. [ 708.506377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.506618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.506618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.506878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.507071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.533889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: IN_PROGRESS for 2s [ 708.602389] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 708.602666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.402143] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 in Status: SUCCESS [ 710.402464] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 deletion is rescheduled due to dependency. [ 710.402813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.547770] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: SUCCESS [ 710.547950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.714328] env[65119]: INFO networking_nsxv3.common.synchronization [req-488f00f9-1668-4b95-8ffe-b2f0575b01ad req-1b821069-7873-47dc-b075-951a14a58d61 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 711.714929] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 711.715893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.716068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.716136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.716332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.716509] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.716630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.716690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.716858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.716948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.717057] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.212363] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1c47ef7c-589a-48c6-bf55-6374044a1e89 None None] Enqueued Resource ID: 703c20f2-bbb8-433f-a46a-dc71fcfd6626 with Priority: HIGHEST for action port [ 712.213080] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703c20f2-bbb8-433f-a46a-dc71fcfd6626 with Priority: HIGHEST for action port [ 712.213341] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-703c20f2-bbb8-433f-a46a-dc71fcfd6626 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.213549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-703c20f2-bbb8-433f-a46a-dc71fcfd6626" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.213641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-703c20f2-bbb8-433f-a46a-dc71fcfd6626" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.213930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-703c20f2-bbb8-433f-a46a-dc71fcfd6626" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.214047] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('703c20f2-bbb8-433f-a46a-dc71fcfd6626',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.219525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.219525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.219525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.219778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.219843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.220036] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.220428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.220428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.220428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.220428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.220574] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 712.255542] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.255542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.255542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.255542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.255542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.263558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 712.358599] env[65119]: INFO networking_nsxv3.common.synchronization [req-fae7c299-bc70-4407-9437-fc734e8cebab req-117fb42b-e479-489f-ab99-122d6e89cf3a tempest-ServersAdminNegativeTestJSON-1695298807 tempest-ServersAdminNegativeTestJSON-1695298807-project-member] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 712.359448] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 712.360729] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.360915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.361055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.361231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.361431] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.361630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.361686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.362062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.362233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.362386] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.716736] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 703c20f2-bbb8-433f-a46a-dc71fcfd6626 [ 712.717068] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.717141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.717258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.717632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.717788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.717949] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:703c20f2-bbb8-433f-a46a-dc71fcfd6626 already deleted. [ 712.718122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-703c20f2-bbb8-433f-a46a-dc71fcfd6626" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.865842] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.370063] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.872302] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.872302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.872302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.872302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.872846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.872846] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be updated. [ 713.900992] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.901209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.901334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.901551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.901720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.916310] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 714.275681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 714.276073] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 714.276971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.583615] env[65119]: INFO networking_nsxv3.common.synchronization [None req-3a896465-9ba3-4e42-a85c-28a05ee4b97c None None] Enqueued Resource ID: 50f4c7bb-7866-461e-ab3b-341b43cf36b0 with Priority: HIGHEST for action port [ 714.584326] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f4c7bb-7866-461e-ab3b-341b43cf36b0 with Priority: HIGHEST for action port [ 714.584673] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f4c7bb-7866-461e-ab3b-341b43cf36b0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.584817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f4c7bb-7866-461e-ab3b-341b43cf36b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.584883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f4c7bb-7866-461e-ab3b-341b43cf36b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.585267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f4c7bb-7866-461e-ab3b-341b43cf36b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.585369] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f4c7bb-7866-461e-ab3b-341b43cf36b0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.090275] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f4c7bb-7866-461e-ab3b-341b43cf36b0 [ 715.090736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.090952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.091047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.091305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.091452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.091633] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f4c7bb-7866-461e-ab3b-341b43cf36b0 already deleted. [ 715.091774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f4c7bb-7866-461e-ab3b-341b43cf36b0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.927922] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 715.928250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.002512] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-cb8ccbe7-a8d1-46e7-8149-dca25310bfc0 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 717.003074] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 717.003375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.003500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.003568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.003825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.003982] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.004791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.004861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.005050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.005140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.005248] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.508936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.509162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.509259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.509556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.509694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.509918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.510060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.510145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.510337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.510436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.510545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc already deleted. [ 717.510654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.590032] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.590032] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.590032] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.590703] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.591897] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.591897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.591897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.591897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.591897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.592504] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.592504] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.592504] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.592504] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.592504] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.592504] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.592685] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.617130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.617318] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.617462] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.617746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.618150] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-c32c3e0a-6355-4c73-a3cd-dcdecd514233 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.618298] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.618363] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.618753] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.618888] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c32c3e0a-6355-4c73-a3cd-dcdecd514233',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.833768] env[65119]: INFO networking_nsxv3.common.synchronization [None req-fe730255-3b79-4956-b7de-8cddf9e78d2e None None] Enqueued Resource ID: 81469921-8182-40b9-a6f1-27414ca5ccc8 with Priority: HIGHEST for action port [ 717.834442] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81469921-8182-40b9-a6f1-27414ca5ccc8 with Priority: HIGHEST for action port [ 717.834757] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-81469921-8182-40b9-a6f1-27414ca5ccc8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.834982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81469921-8182-40b9-a6f1-27414ca5ccc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.835088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81469921-8182-40b9-a6f1-27414ca5ccc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.835350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81469921-8182-40b9-a6f1-27414ca5ccc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.835475] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81469921-8182-40b9-a6f1-27414ca5ccc8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.121875] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.121875] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.122314] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.122346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.122497] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.122686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port c32c3e0a-6355-4c73-a3cd-dcdecd514233 not found, creating... [ 718.122996] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.123129] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.123263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.123493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.123627] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.123927] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.124578] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.124818] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.125223] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.125291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.125491] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: c32c3e0a-6355-4c73-a3cd-dcdecd514233 is going to be created. [ 718.146229] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.146443] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.146693] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.146990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.147232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.147472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.340509] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81469921-8182-40b9-a6f1-27414ca5ccc8 [ 718.340509] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.340509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.340509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.340509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.340509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.340709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81469921-8182-40b9-a6f1-27414ca5ccc8 already deleted. [ 718.340709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81469921-8182-40b9-a6f1-27414ca5ccc8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.948539] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-ea955562-90e9-4eed-878a-c956d8833685 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 718.948758] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-ea955562-90e9-4eed-878a-c956d8833685 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 718.949029] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-ea955562-90e9-4eed-878a-c956d8833685 service nova] Enqueued Resource ID: c32c3e0a-6355-4c73-a3cd-dcdecd514233 with Priority: HIGHEST for action port [ 718.950505] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 718.950651] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 718.950943] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c32c3e0a-6355-4c73-a3cd-dcdecd514233 with Priority: HIGHEST for action port [ 718.951325] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.951450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.951622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.951893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.951893] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.953058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.953058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.953058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.953182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.953290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.954181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.954181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.954181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.954181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.954181] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.954533] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c32c3e0a-6355-4c73-a3cd-dcdecd514233 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.954686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.954783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.954848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.954920] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c32c3e0a-6355-4c73-a3cd-dcdecd514233',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.457303] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.458732] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.458847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.460342] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c32c3e0a-6355-4c73-a3cd-dcdecd514233 with status ACTIVE [ 719.460719] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.460837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.460920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.461138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.461236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.461696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.461696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.461696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.461858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.461858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.462080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.462153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.462185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.462311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.462385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.462467] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c32c3e0a-6355-4c73-a3cd-dcdecd514233 is going to be updated. [ 719.485977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.485977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.485977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.486205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.486205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.486386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c32c3e0a-6355-4c73-a3cd-dcdecd514233" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.589013] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-98cfb182-a4cb-4552-86d3-2f63d59318f2 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 719.589702] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 719.589781] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.589844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.960051] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.008096] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.008096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.008096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.008096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.008096] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.008885] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.009427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.010108] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.010366] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.010658] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.010971] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.011211] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.011419] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.011746] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.011995] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.012311] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.032050] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.032272] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.032409] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.032605] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.032889] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b04fe1c4-0460-4962-9950-93075cdecb3c taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.033077] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.033195] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.033509] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.033645] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b04fe1c4-0460-4962-9950-93075cdecb3c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.394550] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b28ae8ef-2960-4bf0-bab8-913d45ef68f8 None None] Enqueued Resource ID: cc0a1182-3abd-4f7c-8176-c9505f322c1a with Priority: HIGHEST for action port [ 720.395282] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0a1182-3abd-4f7c-8176-c9505f322c1a with Priority: HIGHEST for action port [ 720.398526] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0a1182-3abd-4f7c-8176-c9505f322c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.398526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0a1182-3abd-4f7c-8176-c9505f322c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.398526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0a1182-3abd-4f7c-8176-c9505f322c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.398526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0a1182-3abd-4f7c-8176-c9505f322c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.398526] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0a1182-3abd-4f7c-8176-c9505f322c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.464039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.464381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.464381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.464513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.464632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.464747] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be created. [ 720.491914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.491914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.492071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.492333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.492522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.507697] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: UNINITIALIZED for 2s [ 720.536450] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.537205] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.537363] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.537693] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.538041] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.538041] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b04fe1c4-0460-4962-9950-93075cdecb3c not found, creating... [ 720.538536] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.538536] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.538677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.538803] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.538936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.539223] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.539386] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.539564] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.539936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.540033] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.540229] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b04fe1c4-0460-4962-9950-93075cdecb3c is going to be created. [ 720.565630] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.565912] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.566089] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.566397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.569202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.899574] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc0a1182-3abd-4f7c-8176-c9505f322c1a [ 720.899883] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.900066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.900163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.900427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.900558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.900657] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc0a1182-3abd-4f7c-8176-c9505f322c1a already deleted. [ 720.900764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0a1182-3abd-4f7c-8176-c9505f322c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.287903] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-877704df-30b1-40a4-bb5a-a6c197db4962 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 721.288113] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-877704df-30b1-40a4-bb5a-a6c197db4962 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 721.288656] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-877704df-30b1-40a4-bb5a-a6c197db4962 service nova] Enqueued Resource ID: b04fe1c4-0460-4962-9950-93075cdecb3c with Priority: HIGHEST for action port [ 721.288913] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 721.289106] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 721.289240] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04fe1c4-0460-4962-9950-93075cdecb3c with Priority: HIGHEST for action port [ 721.289566] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.289700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.289959] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.290084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.290297] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b04fe1c4-0460-4962-9950-93075cdecb3c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.290433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.290522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.290815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.290930] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b04fe1c4-0460-4962-9950-93075cdecb3c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.793968] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b04fe1c4-0460-4962-9950-93075cdecb3c with status ACTIVE [ 721.794251] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.794355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.794417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.794659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.794931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.794931] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.795110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.795110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.795286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.795364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.795645] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.795645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.795732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.795854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.795949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.796046] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b04fe1c4-0460-4962-9950-93075cdecb3c is going to be updated. [ 721.819918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.820294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.820294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.820492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.820492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.820617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b04fe1c4-0460-4962-9950-93075cdecb3c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.051522] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-1a42d005-4f5b-433b-94ab-df84c67e6eb4 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 722.052501] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 722.052869] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.052984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.519639] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 722.520447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.520447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.520447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.520622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.520699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.520731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.520904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.520989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.521089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.521192] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.523011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.523137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.523319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.523428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.523491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.523638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.523717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.523807] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.581054] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-823 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.581295] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.582725] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.582725] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.582987] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.583268] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.583348] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.583621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.583790] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.584067] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.584200] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.584311] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.584416] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.584529] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.584630] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.584761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.617416] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.617702] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.617823] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.617992] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-823" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.618560] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-6ce1f15b-722d-4799-930f-356c621be963 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.618560] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.620182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.620182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.620182] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ce1f15b-722d-4799-930f-356c621be963',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.023543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.024089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.026029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.069983] env[65119]: INFO networking_nsxv3.common.synchronization [None req-58855502-b5e9-4c41-bb75-00c06502355d None None] Enqueued Resource ID: f2c88816-3fb6-4118-a29e-3efddfa2eab1 with Priority: HIGHEST for action port [ 723.070991] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c88816-3fb6-4118-a29e-3efddfa2eab1 with Priority: HIGHEST for action port [ 723.070991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c88816-3fb6-4118-a29e-3efddfa2eab1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.070991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c88816-3fb6-4118-a29e-3efddfa2eab1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.071165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c88816-3fb6-4118-a29e-3efddfa2eab1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.071299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c88816-3fb6-4118-a29e-3efddfa2eab1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.071438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c88816-3fb6-4118-a29e-3efddfa2eab1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.122857] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.123116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.123409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.123582] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.123759] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.123952] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 6ce1f15b-722d-4799-930f-356c621be963 not found, creating... [ 723.124388] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.124487] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.124587] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.124882] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.125078] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.125762] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.126643] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.126791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.127061] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.127261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.127525] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 6ce1f15b-722d-4799-930f-356c621be963 is going to be created. [ 723.156038] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.156038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.156038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.156038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.156038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.156038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.528672] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.575765] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2c88816-3fb6-4118-a29e-3efddfa2eab1 [ 723.576203] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.576309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.576360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.576604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.576710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.576828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2c88816-3fb6-4118-a29e-3efddfa2eab1 already deleted. [ 723.576977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c88816-3fb6-4118-a29e-3efddfa2eab1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.896049] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-0dc25c9f-cb19-4c11-99c4-7a4b68016058 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 723.896049] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-0dc25c9f-cb19-4c11-99c4-7a4b68016058 service nova] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 723.896049] env[65119]: INFO networking_nsxv3.common.synchronization [req-0de2a9d9-ed99-4539-85f3-b76b442ca57a req-0dc25c9f-cb19-4c11-99c4-7a4b68016058 service nova] Enqueued Resource ID: 6ce1f15b-722d-4799-930f-356c621be963 with Priority: HIGHEST for action port [ 723.896504] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_rules [ 723.896640] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 723.896741] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce1f15b-722d-4799-930f-356c621be963 with Priority: HIGHEST for action port [ 723.897019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.897390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.897652] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.897758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.897950] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ce1f15b-722d-4799-930f-356c621be963 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.898065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.898128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.898319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.898502] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ce1f15b-722d-4799-930f-356c621be963',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.030440] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.030782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.030782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.030956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.031077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.031191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 724.064387] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.064387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.064387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.064387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.064387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.075182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 724.401372] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ce1f15b-722d-4799-930f-356c621be963 with status ACTIVE [ 724.401484] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.401746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.401784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.402024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.402122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.402323] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.402431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.402494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.402670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.402748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.402932] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.403034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.404970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.404970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.404970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.404970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ce1f15b-722d-4799-930f-356c621be963 is going to be updated. [ 724.432044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.433248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.433248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.433248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.433248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.433248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ce1f15b-722d-4799-930f-356c621be963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.535991] env[65119]: INFO networking_nsxv3.common.synchronization [req-35367343-7bed-4835-a918-6aa7821ed3fa req-07ef2d9f-47d4-44da-be3d-4dd351d1cecc tempest-ServerMetadataNegativeTestJSON-525433860 tempest-ServerMetadataNegativeTestJSON-525433860-project-member] Enqueued Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 724.537236] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 724.540324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.540626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.540626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.541172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.541444] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.541806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.541806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.542027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.542159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.542353] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.014155] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.014155] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-945" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.014155] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-945" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.014155] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-945" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.014155] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.015435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.015550] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.016440] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.016733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.016983] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.017170] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.017341] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.017480] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.018832] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.018832] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.018832] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.044332] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.044332] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.044332] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.044332] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-945" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.044332] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.044332] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.045645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.045645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.045645] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7ff9b0-f881-452f-81b2-75f2b7060c8e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.049028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.049282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.049662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.049968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.050162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.050538] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.050703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.050848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.052099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.052099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.052099] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 already deleted. [ 725.052099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.405297] env[65119]: INFO networking_nsxv3.common.synchronization [None req-156095bb-1d73-4310-a436-2d2bfe45a5f4 None None] Enqueued Resource ID: 97303017-2218-477a-9176-689a1138655b with Priority: HIGHEST for action port [ 725.407159] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97303017-2218-477a-9176-689a1138655b with Priority: HIGHEST for action port [ 725.407786] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-97303017-2218-477a-9176-689a1138655b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.407786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97303017-2218-477a-9176-689a1138655b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.407988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97303017-2218-477a-9176-689a1138655b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.408090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97303017-2218-477a-9176-689a1138655b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.408191] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97303017-2218-477a-9176-689a1138655b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.551130] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.551130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port ae7ff9b0-f881-452f-81b2-75f2b7060c8e not found, creating... [ 725.551130] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.551130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.551914] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.551914] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.552579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.553365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.554068] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.556552] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: ae7ff9b0-f881-452f-81b2-75f2b7060c8e is going to be created. [ 725.577454] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.577864] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.578096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.578525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.578875] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.579184] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.911259] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97303017-2218-477a-9176-689a1138655b [ 725.911408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.911543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.911723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.911852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.911948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.912054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97303017-2218-477a-9176-689a1138655b already deleted. [ 725.912136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97303017-2218-477a-9176-689a1138655b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.087902] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 726.088214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.088322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.088540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.088739] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.088858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.088923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.089096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.089223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.089267] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.297045] env[65119]: INFO networking_nsxv3.common.synchronization [req-35367343-7bed-4835-a918-6aa7821ed3fa req-be3e4da7-69d8-4942-9f70-bafac01adf84 service nova] Enqueued Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_rules [ 726.297233] env[65119]: INFO networking_nsxv3.common.synchronization [req-35367343-7bed-4835-a918-6aa7821ed3fa req-be3e4da7-69d8-4942-9f70-bafac01adf84 service nova] Enqueued Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 726.297376] env[65119]: INFO networking_nsxv3.common.synchronization [req-35367343-7bed-4835-a918-6aa7821ed3fa req-be3e4da7-69d8-4942-9f70-bafac01adf84 service nova] Enqueued Resource ID: ae7ff9b0-f881-452f-81b2-75f2b7060c8e with Priority: HIGHEST for action port [ 726.297999] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_rules [ 726.302462] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 726.302629] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae7ff9b0-f881-452f-81b2-75f2b7060c8e with Priority: HIGHEST for action port [ 726.303357] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.303584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.303584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.303868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.303986] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.305681] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.305808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.305877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.306667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.306847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.306958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.307148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.307217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.307309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.307416] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.308632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.308743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.308783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.309041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.309434] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7ff9b0-f881-452f-81b2-75f2b7060c8e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.592335] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.810857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.811053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.811303] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae7ff9b0-f881-452f-81b2-75f2b7060c8e with status ACTIVE [ 726.811518] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.811688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.811767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.812031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.812153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.812371] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.812494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.812788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.812788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.812894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.813207] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.813283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.813335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.813516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.813999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.814275] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae7ff9b0-f881-452f-81b2-75f2b7060c8e is going to be updated. [ 726.815648] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.843287] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.844025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.844142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.844357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.844499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.844662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae7ff9b0-f881-452f-81b2-75f2b7060c8e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.882020] env[65119]: INFO networking_nsxv3.common.synchronization [req-38f98c6c-7801-4e7c-bbc3-34cd65025c26 req-45728013-c30b-466b-9406-72143ba69689 tempest-SecurityGroupRulesNegativeTestJSON-1925687686 tempest-SecurityGroupRulesNegativeTestJSON-1925687686-project-member] Enqueued Resource ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 with Priority: HIGHEST for action security_group_rules [ 726.882020] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 with Priority: HIGHEST for action security_group_rules [ 726.883715] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7f4a59d-af24-4b6d-89b4-f95920923de7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.885014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.885014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.885014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.885014] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7f4a59d-af24-4b6d-89b4-f95920923de7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.094035] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.267435] env[65119]: INFO networking_nsxv3.common.synchronization [req-2ab803d6-8a97-4210-9368-254a86d3874f req-e6179084-ce3e-4112-8b5f-1d4f1ac1476e tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 727.270232] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 727.270726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.270934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.271101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.271482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.271758] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.271948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.272095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.272408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.272570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.272995] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.319290] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.408676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.408925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.409047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.409309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.409952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.409952] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 already deleted. [ 727.409952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.597016] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.597219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.597265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.597748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.597748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.597811] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 727.630637] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.630990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.630990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.631221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.631421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.643099] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 727.718957] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.718957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.718957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.719365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.719667] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.719857] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.719990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.720264] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.720416] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.720621] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.720788] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.720916] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.721055] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.721183] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.721289] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.721418] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.753562] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.753804] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.753804] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.753989] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.754381] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.756033] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.756033] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.756033] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.756033] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aca1bcf-20e7-4f1a-a0f3-a02b2954e363',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.778657] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.778840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.778959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.779184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.779494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.779741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.779918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.780110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.781048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.781048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.781048] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 727.814327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.815160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.815160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.815160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.815160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.822228] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.822467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.823787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.823787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.823787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.823787] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 is going to be created. [ 727.826186] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 727.851612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.851761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.851832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.852780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.852780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.887716] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: UNINITIALIZED for 2s [ 728.260422] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.260422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.260422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.260422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.260422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.260422] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 not found, creating... [ 728.260422] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.260422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.261237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.261237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.261384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.262018] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.262318] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.262487] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.262871] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.263091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.263357] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 is going to be created. [ 728.295999] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.296235] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.296361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.297397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.297397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.297522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.442131] env[65119]: INFO networking_nsxv3.common.synchronization [req-2ab803d6-8a97-4210-9368-254a86d3874f req-72d0c9dc-6aa2-4494-b4bd-0e9d012873df service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 729.442527] env[65119]: INFO networking_nsxv3.common.synchronization [req-2ab803d6-8a97-4210-9368-254a86d3874f req-72d0c9dc-6aa2-4494-b4bd-0e9d012873df service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 729.442527] env[65119]: INFO networking_nsxv3.common.synchronization [req-2ab803d6-8a97-4210-9368-254a86d3874f req-72d0c9dc-6aa2-4494-b4bd-0e9d012873df service nova] Enqueued Resource ID: 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 with Priority: HIGHEST for action port [ 729.443844] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 729.443999] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 729.444102] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 with Priority: HIGHEST for action port [ 729.444388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.444509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.444584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.444785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.444862] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.450031] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.450031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.450031] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.450031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.450031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.450031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.450031] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aca1bcf-20e7-4f1a-a0f3-a02b2954e363',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.584596] env[65119]: INFO networking_nsxv3.common.synchronization [None req-bd1acfef-c290-45b9-b6db-4e8128ebe0a2 None None] Enqueued Resource ID: 49e70477-d6b6-49c1-b7dc-750dd6a01506 with Priority: HIGHEST for action port [ 729.586018] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e70477-d6b6-49c1-b7dc-750dd6a01506 with Priority: HIGHEST for action port [ 729.586018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-49e70477-d6b6-49c1-b7dc-750dd6a01506 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.586018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49e70477-d6b6-49c1-b7dc-750dd6a01506" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.586018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49e70477-d6b6-49c1-b7dc-750dd6a01506" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.586018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49e70477-d6b6-49c1-b7dc-750dd6a01506" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.586018] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49e70477-d6b6-49c1-b7dc-750dd6a01506',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.656976] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 729.657362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.657676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.658017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.658239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.658363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.658433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.658595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.658681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.658804] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.838105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 729.838347] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 729.838446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.839018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.839246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.839477] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.839672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.839728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.840134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.840134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.840134] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.902130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: SUCCESS [ 729.902549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.904418] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.904418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.904735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.904735] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.947718] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.947718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.952432] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 with status ACTIVE [ 729.954048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.954048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.954293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.954293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.954348] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.954665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.954721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.954799] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9aca1bcf-20e7-4f1a-a0f3-a02b2954e363 is going to be updated. [ 729.979774] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.979774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.979774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.980078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.980114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.981186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aca1bcf-20e7-4f1a-a0f3-a02b2954e363" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.088376] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49e70477-d6b6-49c1-b7dc-750dd6a01506 [ 730.088671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.088863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.088933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.089215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.090498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.090498] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49e70477-d6b6-49c1-b7dc-750dd6a01506 already deleted. [ 730.090498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49e70477-d6b6-49c1-b7dc-750dd6a01506" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.161315] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.318467] env[65119]: INFO networking_nsxv3.common.synchronization [req-f31d3dc6-254c-4bdb-82f6-66d99a35d922 req-c41d316c-bf1f-41f6-b8c8-5a6d4913f6a3 tempest-FloatingIPsAssociationTestJSON-1574037461 tempest-FloatingIPsAssociationTestJSON-1574037461-project-member] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 730.321967] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 730.321967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.321967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.321967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.321967] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.342956] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.411112] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.411112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.411112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.411112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.411434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.411434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.411434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.411551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.411551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.412124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.412124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.412124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.412124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.412382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.412382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.412458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.412505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.413027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.413027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.413027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.413027] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.664209] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.824217] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.824366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.825735] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.825735] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 already deleted. [ 730.825735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.852663] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.916213] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09eeb8ed-53fe-4534-ba39-d93429300967: rpc.has_security_group_logging(os_id): False [ 730.937142] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.937581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.938522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.938522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.938841] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.938841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.938841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.939616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.939616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.939616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.939616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.939616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.939616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.939898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.939898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 is going to be created. [ 731.013094] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.013270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.013343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.013564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.015285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.030832] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: IN_PROGRESS for 2s [ 731.140382] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.140382] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.140382] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.140382] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.141634] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.141863] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.141991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.142275] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.142437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.142636] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.142745] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.142850] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.142955] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.143079] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.143181] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.143324] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.168161] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.168161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.168161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.168415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.168415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.168415] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 731.188584] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.188584] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.188584] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.188584] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.188584] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-2612d1ed-b9ec-48c1-a802-3a90e6c34416 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.188584] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.188584] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.189136] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.189136] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2612d1ed-b9ec-48c1-a802-3a90e6c34416',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.217503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.218055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.218174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.218443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.218853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.231204] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 731.355824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.355987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.356107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.356345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.356451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.356578] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 731.407938] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.408266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.408266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.408449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.408619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.419952] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 731.694892] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.694892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.694892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.694892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.694892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.694892] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 2612d1ed-b9ec-48c1-a802-3a90e6c34416 not found, creating... [ 731.694892] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.695861] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.696113] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.696638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.696708] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.697145] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.697397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.697572] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.697912] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.698130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.698381] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 2612d1ed-b9ec-48c1-a802-3a90e6c34416 is going to be created. [ 731.725446] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.725695] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.725876] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.727391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.727391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.727391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.384225] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7b2f52ad-30ea-4a68-9b7d-43021c2ff4ad None None] Enqueued Resource ID: 39ad98a4-db99-4b6b-baca-86de988ed15a with Priority: HIGHEST for action port [ 732.384938] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ad98a4-db99-4b6b-baca-86de988ed15a with Priority: HIGHEST for action port [ 732.386632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ad98a4-db99-4b6b-baca-86de988ed15a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.386817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ad98a4-db99-4b6b-baca-86de988ed15a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.386852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ad98a4-db99-4b6b-baca-86de988ed15a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.387149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ad98a4-db99-4b6b-baca-86de988ed15a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.387433] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ad98a4-db99-4b6b-baca-86de988ed15a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.480457] env[65119]: INFO networking_nsxv3.common.synchronization [req-f31d3dc6-254c-4bdb-82f6-66d99a35d922 req-6e2b7b59-9357-40c9-9f52-6b6f21fc0ee0 service nova] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_rules [ 732.480700] env[65119]: INFO networking_nsxv3.common.synchronization [req-f31d3dc6-254c-4bdb-82f6-66d99a35d922 req-6e2b7b59-9357-40c9-9f52-6b6f21fc0ee0 service nova] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 732.480862] env[65119]: INFO networking_nsxv3.common.synchronization [req-f31d3dc6-254c-4bdb-82f6-66d99a35d922 req-6e2b7b59-9357-40c9-9f52-6b6f21fc0ee0 service nova] Enqueued Resource ID: 2612d1ed-b9ec-48c1-a802-3a90e6c34416 with Priority: HIGHEST for action port [ 732.481739] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_rules [ 732.481739] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 732.481739] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2612d1ed-b9ec-48c1-a802-3a90e6c34416 with Priority: HIGHEST for action port [ 732.482171] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.483124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.483329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.483553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.483714] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.485944] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.487152] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.487152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.487441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.489866] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2612d1ed-b9ec-48c1-a802-3a90e6c34416 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.490808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.490808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.490808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.490808] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2612d1ed-b9ec-48c1-a802-3a90e6c34416',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.890134] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39ad98a4-db99-4b6b-baca-86de988ed15a [ 732.890540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.890649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.891143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.891501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.891572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.891648] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39ad98a4-db99-4b6b-baca-86de988ed15a already deleted. [ 732.891726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ad98a4-db99-4b6b-baca-86de988ed15a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.994228] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.994228] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.994228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.994551] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2612d1ed-b9ec-48c1-a802-3a90e6c34416 with status ACTIVE [ 732.994834] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.994967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.995523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.995523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.995523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.995523] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.995694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.995735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.995889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.000025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.000025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.000025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.000025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.000025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.000025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.000025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2612d1ed-b9ec-48c1-a802-3a90e6c34416 is going to be updated. [ 733.023685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.023908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.024048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.024308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.025617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.025617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2612d1ed-b9ec-48c1-a802-3a90e6c34416" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.045287] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: SUCCESS [ 733.045599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.243730] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 733.245060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.245060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.245250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.245382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.245613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.245613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.245866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.245982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.246111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.246331] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.246439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.246542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.246709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.246929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.247039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.247125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.247308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.247412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.247519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.247640] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.248813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.249070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.249328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.249437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.249523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.249715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.249831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.249963] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.430516] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 733.430745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.430925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.431170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.431369] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.431540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.431540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.431698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.431782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.431867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.431959] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.502029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.754613] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.756016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1716238a-d758-431d-b1b3-35d3e7b9b9bc: rpc.has_security_group_logging(os_id): False [ 733.777948] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.778275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.778275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.778511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.778701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.779053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.779240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.779360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.779650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.779942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.780292] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.780416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.780486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.780730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.780822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.780982] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.781090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.781280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.781321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.781571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.781571] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be created. [ 733.867606] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.867829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.867870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.868117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.868323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.880682] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 733.935412] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.935412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.935412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.935819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.935819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.935914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.935973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.936670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.936670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.936670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.936670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.936670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.936670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.937121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.937121] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.937121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.937121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.937326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.937326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.937530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.937530] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.004188] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.004418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.004532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.004739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.005406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.005406] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be created. [ 734.036468] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.036700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.036917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.037227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.037435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.052191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: UNINITIALIZED for 2s [ 734.258989] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.440585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154abdb7-4268-41a3-bf4b-26f5e9656c76: rpc.has_security_group_logging(os_id): False [ 734.462668] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.462668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.462668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.462861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.462978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.463702] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.464062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.464208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.464374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.464498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.464771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.464896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.464998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.467022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.467022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.467022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.467022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.467022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.467239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.467239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.467333] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 734.558429] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.559613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.559613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.559613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.559613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.575947] env[65119]: INFO networking_nsxv3.common.synchronization [req-b7126cd5-7670-4cf7-8487-9ab78d0ec973 req-ba011e1e-c90e-45b9-a3ef-f91539550a47 tempest-SecurityGroupRulesNegativeTestJSON-1925687686 tempest-SecurityGroupRulesNegativeTestJSON-1925687686-project-member] Enqueued Resource ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 with Priority: HIGHEST for action security_group_rules [ 734.578501] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 734.580462] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 with Priority: HIGHEST for action security_group_rules [ 734.580462] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7f4a59d-af24-4b6d-89b4-f95920923de7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.580462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.580462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.580462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.580462] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7f4a59d-af24-4b6d-89b4-f95920923de7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.759336] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9006b105-03d4-46da-a832-1152487c68bf None None] Enqueued Resource ID: 63045221-0c03-4263-9cf5-4e52c446b998 with Priority: HIGHEST for action port [ 734.760168] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63045221-0c03-4263-9cf5-4e52c446b998 with Priority: HIGHEST for action port [ 734.760616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-63045221-0c03-4263-9cf5-4e52c446b998 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.760785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63045221-0c03-4263-9cf5-4e52c446b998" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.760785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63045221-0c03-4263-9cf5-4e52c446b998" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.761066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63045221-0c03-4263-9cf5-4e52c446b998" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.761117] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63045221-0c03-4263-9cf5-4e52c446b998',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.764634] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.764634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.764754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.765183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.765183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.767359] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 734.804326] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.804550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.804841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.804968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.805183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.822169] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 735.106025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.106025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.106025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.106025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.106025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.106025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7f4a59d-af24-4b6d-89b4-f95920923de7 already deleted. [ 735.106025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7f4a59d-af24-4b6d-89b4-f95920923de7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.265551] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63045221-0c03-4263-9cf5-4e52c446b998 [ 735.266641] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.269697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.269697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.269697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.269697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.269697] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63045221-0c03-4263-9cf5-4e52c446b998 already deleted. [ 735.269697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63045221-0c03-4263-9cf5-4e52c446b998" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.894431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 735.894726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.894890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.895184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.895341] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.063467] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 736.063700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.063879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.064231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.064498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.065151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.065151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.065151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.065151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.065151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.065359] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.398024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.398606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.568897] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.569116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.569225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.569497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.570290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.570290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.570290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.570538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.570625] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.570771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.570853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.571376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.571441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571954] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.599724] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 736.601899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.834335] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 736.834606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.834772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.835043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.835308] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.835441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.835441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.835623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.835737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.835832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.835955] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.978528] env[65119]: INFO networking_nsxv3.common.synchronization [None req-42ac4db3-6b2e-456f-ba11-67acea27edaa None None] Enqueued Resource ID: 8f3b3352-bca7-42f8-a5d5-f8806d45d4bf with Priority: HIGHEST for action port [ 736.979385] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f3b3352-bca7-42f8-a5d5-f8806d45d4bf with Priority: HIGHEST for action port [ 736.980101] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f3b3352-bca7-42f8-a5d5-f8806d45d4bf taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.980903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f3b3352-bca7-42f8-a5d5-f8806d45d4bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.980903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f3b3352-bca7-42f8-a5d5-f8806d45d4bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.980903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f3b3352-bca7-42f8-a5d5-f8806d45d4bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.980903] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f3b3352-bca7-42f8-a5d5-f8806d45d4bf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.074368] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197: rpc.has_security_group_logging(os_id): False [ 737.092415] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.092658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.092778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.093098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.093216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.093490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.093655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.093726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.093925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.094746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.095083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.095265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.095405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.096200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.096543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.096977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.097207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.097306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.097478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.097587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097955] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be created. [ 737.160992] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.161240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.161305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.161518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.161702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.175503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 737.338726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.339083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.339178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.339503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.339872] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.340116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.340233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.340545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.340979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.340979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.341109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.341451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.341596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.341821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.342034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.342146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.342213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.342390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.342481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.342566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.342677] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.482950] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f3b3352-bca7-42f8-a5d5-f8806d45d4bf [ 737.483320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.483481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.483565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.483833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.483959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.484088] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f3b3352-bca7-42f8-a5d5-f8806d45d4bf already deleted. [ 737.484230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f3b3352-bca7-42f8-a5d5-f8806d45d4bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.722457] env[65119]: INFO networking_nsxv3.common.synchronization [None req-d910ea16-1900-4178-8fd8-16c735ca976d None None] Enqueued Resource ID: e32770bf-547e-4659-b07e-3ba818831075 with Priority: HIGHEST for action port [ 737.723263] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e32770bf-547e-4659-b07e-3ba818831075 with Priority: HIGHEST for action port [ 737.723853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e32770bf-547e-4659-b07e-3ba818831075 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.724060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e32770bf-547e-4659-b07e-3ba818831075" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.724159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e32770bf-547e-4659-b07e-3ba818831075" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.724463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e32770bf-547e-4659-b07e-3ba818831075" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.724599] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e32770bf-547e-4659-b07e-3ba818831075',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.845561] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1716238a-d758-431d-b1b3-35d3e7b9b9bc: rpc.has_security_group_logging(os_id): False [ 737.869712] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.870672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.870809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.871090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.871194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.871432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.871538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.871644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.871808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.871893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.872117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.872432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.872432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.872432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.872659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.872706] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.872990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.872990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.872990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.873233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.873233] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 737.983298] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.983425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.983498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.983703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.983869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.007350] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 738.227094] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e32770bf-547e-4659-b07e-3ba818831075 [ 738.227341] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.227433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.227505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.227844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.227955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.228110] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e32770bf-547e-4659-b07e-3ba818831075 already deleted. [ 738.228220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e32770bf-547e-4659-b07e-3ba818831075" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.068672] env[65119]: INFO networking_nsxv3.common.synchronization [None req-df45a927-6eee-4ecd-8fa1-2a4d9c840b06 tempest-ServersTestJSON-1698246118 tempest-ServersTestJSON-1698246118-project-member] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 739.069400] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 739.070259] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.070259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.070259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.070259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.070259] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.175470] env[65119]: INFO networking_nsxv3.common.synchronization [None req-4914fdb7-6f94-425e-81d5-afb3963eb70d tempest-ServersTestJSON-1698246118 tempest-ServersTestJSON-1698246118-project-member] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 739.176949] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 739.180617] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.180747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.196208] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 739.196458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.595325] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.595325] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 already deleted. [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.595325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.595325] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.028824] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 740.028824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.028824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.028824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.028824] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.119617] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.123160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.123160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.123160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.123160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.123160] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 already deleted. [ 740.123160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.416814] env[65119]: INFO networking_nsxv3.common.synchronization [None req-54739ba6-8f94-4aee-8626-f5ea8dd049d5 tempest-ServersTestFqdnHostnames-1879836506 tempest-ServersTestFqdnHostnames-1879836506-project-member] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 740.417320] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 740.417689] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.417869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.417939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.418646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.418746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.532531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.532705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.532811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.533078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.533261] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.533387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.533456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.533585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.533673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.534936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.534936] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.555538] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a6ffd102-7c43-4353-b45a-dafea54d0b5b tempest-ServersTestFqdnHostnames-1879836506 tempest-ServersTestFqdnHostnames-1879836506-project-member] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 740.558212] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 740.558815] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.558815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.944193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.944193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.944193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.944585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.944585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.944585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 already deleted. [ 740.944668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.944845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.945038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.945108] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.040976] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.040976] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.040976] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.040976] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.040976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.041796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.041796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.041796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.041796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.041796] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.471709] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.472032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.472032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.472200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.472514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.472817] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 already deleted. [ 741.472817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.545841] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1716238a-d758-431d-b1b3-35d3e7b9b9bc: rpc.has_security_group_logging(os_id): False [ 741.573983] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.574895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.574966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.575250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.577035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.577035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.577035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.578213] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.578213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.578213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.578213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.578213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.578213] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 741.671632] env[65119]: INFO networking_nsxv3.common.synchronization [req-0601dc16-d709-443f-a0e4-c6a3bbb9fdb7 req-cb3daacb-53b5-4b0f-8796-fe644dd285bf tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 741.672213] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 741.672546] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.672828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.672828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.673017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.677285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.677494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.677542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.677878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.677878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.678039] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.680145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.680145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.680145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.680393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.680505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.705589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 741.768111] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0aad61ad-4ad9-4d85-a5af-11ef1b4426dc None None] Enqueued Resource ID: 5fbd326f-bd0e-4931-a648-93a2f54ea787 with Priority: HIGHEST for action port [ 741.768730] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbd326f-bd0e-4931-a648-93a2f54ea787 with Priority: HIGHEST for action port [ 741.769455] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fbd326f-bd0e-4931-a648-93a2f54ea787 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.769611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fbd326f-bd0e-4931-a648-93a2f54ea787" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.769659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fbd326f-bd0e-4931-a648-93a2f54ea787" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.770044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fbd326f-bd0e-4931-a648-93a2f54ea787" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.770178] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fbd326f-bd0e-4931-a648-93a2f54ea787',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.182869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.272847] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fbd326f-bd0e-4931-a648-93a2f54ea787 [ 742.272990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.273204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.273291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.273797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.273797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.273797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fbd326f-bd0e-4931-a648-93a2f54ea787 already deleted. [ 742.273797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fbd326f-bd0e-4931-a648-93a2f54ea787" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.351313] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.351313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.351313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.351492] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.351743] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.352206] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.352206] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.352331] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.352474] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.352696] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.352830] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.353022] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.353090] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.353215] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.353338] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.353470] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.376631] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.376631] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.377488] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.377488] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.377488] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-05143a8c-2a35-4711-af99-a39a9a34e12c taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.377488] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.378564] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.378564] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.378693] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05143a8c-2a35-4711-af99-a39a9a34e12c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.685552] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.881630] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.881859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.881984] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.882280] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.882427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.882575] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 05143a8c-2a35-4711-af99-a39a9a34e12c not found, creating... [ 742.882838] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.882997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.883123] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.883335] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.883465] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.883741] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.883891] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.884010] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.884221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.884349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.884481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 05143a8c-2a35-4711-af99-a39a9a34e12c is going to be created. [ 742.909337] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.909536] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.909654] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.909932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.910281] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.910533] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.188419] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.188605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.188657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.188884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.188985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.189085] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 743.223788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.224012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.224012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.224226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.224375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.234693] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 743.645690] env[65119]: INFO networking_nsxv3.common.synchronization [req-0601dc16-d709-443f-a0e4-c6a3bbb9fdb7 req-ad41306d-c2c6-4581-9e3c-b8926ce73af7 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 743.645748] env[65119]: INFO networking_nsxv3.common.synchronization [req-0601dc16-d709-443f-a0e4-c6a3bbb9fdb7 req-ad41306d-c2c6-4581-9e3c-b8926ce73af7 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 743.645868] env[65119]: INFO networking_nsxv3.common.synchronization [req-0601dc16-d709-443f-a0e4-c6a3bbb9fdb7 req-ad41306d-c2c6-4581-9e3c-b8926ce73af7 service nova] Enqueued Resource ID: 05143a8c-2a35-4711-af99-a39a9a34e12c with Priority: HIGHEST for action port [ 743.646566] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 743.646703] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 743.646802] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05143a8c-2a35-4711-af99-a39a9a34e12c with Priority: HIGHEST for action port [ 743.647084] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.647206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.647489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.647800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.647800] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.648713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.648713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.648922] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-05143a8c-2a35-4711-af99-a39a9a34e12c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.649040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.649095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.649273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.649341] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05143a8c-2a35-4711-af99-a39a9a34e12c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.723907] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 743.724307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.152790] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.153188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.157107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05143a8c-2a35-4711-af99-a39a9a34e12c with status ACTIVE [ 744.157107] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.157107] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.157107] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.157107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.157107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05143a8c-2a35-4711-af99-a39a9a34e12c is going to be updated. [ 744.184649] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.184897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.184897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.185117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.185264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.185433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05143a8c-2a35-4711-af99-a39a9a34e12c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.247074] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 745.247391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.247517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.247740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.247956] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.248101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.248169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.248325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.248428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.248537] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.754175] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.857101] env[65119]: INFO networking_nsxv3.common.synchronization [req-50c78450-8de3-48b6-a978-94c3942374e8 req-d541ba12-7764-464e-a1fc-62a3d70830fb tempest-ImagesOneServerTestJSON-1737876565 tempest-ImagesOneServerTestJSON-1737876565-project-member] Enqueued Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 745.857655] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07660c72-b919-4d62-b37d-9ae294d80c7d with Priority: HIGHEST for action security_group_members [ 745.858212] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-07660c72-b919-4d62-b37d-9ae294d80c7d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.858290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.858531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.858641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.858998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.858998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.858998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.859264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.859394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.859540] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07660c72-b919-4d62-b37d-9ae294d80c7d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.257271] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.367213] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367213] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.367213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367213] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07660c72-b919-4d62-b37d-9ae294d80c7d is going to be updated. [ 746.398913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.398913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.398913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.398913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.398913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.411411] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: IN_PROGRESS for 2s [ 746.575336] env[65119]: INFO networking_nsxv3.common.synchronization [req-c68f050b-380e-4837-9257-40a9c09adde3 req-49d4e88a-a3eb-4a6d-ae03-0d4974ded03c tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 746.576119] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 746.576776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.576776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.576776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.576918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.577279] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.577279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.577279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.577434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.577434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.577489] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.760482] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.760684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.760725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.760950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.761057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.761159] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 746.804515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.804679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.804735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.804953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.805136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.815991] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 747.079620] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.583297] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.709690] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.709879] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.709998] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.710436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.710524] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.710662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.710770] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.710977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.711133] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.711336] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.711439] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.711536] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.711631] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.711731] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.711824] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.711947] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.731805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.731805] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.732049] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.732140] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-770" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.732446] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732608] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732812] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.733057] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.733217] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b5471f-a83a-4bf7-9bce-39ffdeee0562',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.086056] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.086305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.086305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.086520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.086613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.086713] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 748.119631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.119840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.119840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.120185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.121169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.131139] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 748.235468] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.235746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.235925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.236247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.236431] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.236599] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port b3b5471f-a83a-4bf7-9bce-39ffdeee0562 not found, creating... [ 748.236866] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.237030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.237143] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.237398] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.237547] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.237910] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.238103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.238223] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.238468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.238846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.238846] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 is going to be created. [ 748.268977] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.269248] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.269369] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.269744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.269886] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.270145] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.425948] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07660c72-b919-4d62-b37d-9ae294d80c7d in Status: SUCCESS [ 748.426192] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07660c72-b919-4d62-b37d-9ae294d80c7d deletion is rescheduled due to dependency. [ 748.426345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07660c72-b919-4d62-b37d-9ae294d80c7d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.505581] env[65119]: INFO networking_nsxv3.common.synchronization [None req-2e529d42-39fe-46c9-a175-04afb4b7365e None None] Enqueued Resource ID: 0a1debad-f53f-47bb-9a1d-314f363cd65f with Priority: HIGHEST for action port [ 748.506106] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1debad-f53f-47bb-9a1d-314f363cd65f with Priority: HIGHEST for action port [ 748.506408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1debad-f53f-47bb-9a1d-314f363cd65f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.506534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1debad-f53f-47bb-9a1d-314f363cd65f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.506601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1debad-f53f-47bb-9a1d-314f363cd65f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.506854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1debad-f53f-47bb-9a1d-314f363cd65f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.506995] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1debad-f53f-47bb-9a1d-314f363cd65f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.828108] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.828108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828108] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.010933] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a1debad-f53f-47bb-9a1d-314f363cd65f [ 749.011184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.011320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.011531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.011607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.011770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.011832] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a1debad-f53f-47bb-9a1d-314f363cd65f already deleted. [ 749.011867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1debad-f53f-47bb-9a1d-314f363cd65f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.021408] env[65119]: INFO networking_nsxv3.common.synchronization [req-c68f050b-380e-4837-9257-40a9c09adde3 req-30480a67-2499-41dd-85d9-8925ddfd2332 service nova] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 749.021408] env[65119]: INFO networking_nsxv3.common.synchronization [req-c68f050b-380e-4837-9257-40a9c09adde3 req-30480a67-2499-41dd-85d9-8925ddfd2332 service nova] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 749.021482] env[65119]: INFO networking_nsxv3.common.synchronization [req-c68f050b-380e-4837-9257-40a9c09adde3 req-30480a67-2499-41dd-85d9-8925ddfd2332 service nova] Enqueued Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 749.021676] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 749.021811] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 749.021908] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 749.023947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.023947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.023947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.024114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.024210] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.025888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.025975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.026191] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.026294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.026357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.026526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.026603] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b5471f-a83a-4bf7-9bce-39ffdeee0562',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.332090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.332090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.332090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.332090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.332897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.332897] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.332897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.332897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.332897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.332897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.333143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.333178] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.433977] env[65119]: INFO networking_nsxv3.common.synchronization [req-41990ffb-510d-4161-a477-570e9c08a355 req-670de9d9-cd26-4cdd-b968-9210236ab4a1 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 749.435032] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 749.435880] env[65119]: INFO networking_nsxv3.common.synchronization [req-b8b55792-197b-4f16-b5ee-d4e37428adad req-a8ec46fe-e0dd-4975-9cf3-e88937a6e40b tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 749.436209] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.436329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.436392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.436592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.436759] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.436856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.436914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.437073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.437155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.437249] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.438917] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 749.438917] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.438917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.438917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.439162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439162] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.439331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.439331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.439471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.439626] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.527309] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.527544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.529477] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with status ACTIVE [ 749.529758] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.529943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.530029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.530636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.530636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.530874] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.530944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.530991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.531298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.531685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.531685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.531933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.531933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.532404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.532404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.532404] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 is going to be updated. [ 749.554668] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.554668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.554668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.554668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.554832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.555873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.835709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4688087-743d-4d09-ac40-3272e1f90bc5: rpc.has_security_group_logging(os_id): False [ 749.854337] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.854573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.854573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.855336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.855336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.855427] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.855561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.855665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.855940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.856856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.857840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.857840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.857840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.857840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.858092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.859060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.859060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.859060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.859060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.859060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.859308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 749.938234] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.938234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.938234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.938234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.938234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.939318] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.940807] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.940995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.941277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.941382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.941546] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.943648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.943648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.943648] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 749.958563] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 749.977249] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.977391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.977461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.977692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.977901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.989904] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 750.142304] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 750.142580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.142794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.143195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.143444] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.143620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.143703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.143908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.144034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.144148] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.446978] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.647716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.950609] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.951024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.951024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.951212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.951426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.951587] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 751.000592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.000592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.000592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.000592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.003450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.016026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 751.047172] env[65119]: INFO networking_nsxv3.common.synchronization [req-f98763eb-b54a-4b27-af9f-ddede77ef607 req-56a66f28-d20f-43b9-939e-7af267a3a6b9 tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 751.047172] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 751.047743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.048126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.048285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.049415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.049688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.049918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.050670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.050880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.050984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.051115] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.150048] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.492823] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.493030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.493153] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.493415] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.493670] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.493849] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.493970] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.494249] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.494333] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.494461] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.494579] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.494682] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.494785] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.494889] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.494992] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.495147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.522526] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.522795] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.522988] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.523280] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.523748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-e25ca576-a454-4e7b-9525-66c373db7791 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.523990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.524168] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.524573] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.524752] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e25ca576-a454-4e7b-9525-66c373db7791',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.558673] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.654035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.654035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.654035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.654035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.654035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.654035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 751.697338] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.697528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.697572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.697762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.697974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.708607] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b6b920a6-3e98-4642-a4a4-a6bcc778d644 tempest-ServersV294TestFqdnHostnames-1932911180 tempest-ServersV294TestFqdnHostnames-1932911180-project-member] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 751.709790] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 751.710761] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 751.710929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.711065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.711134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.711383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.711631] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.973016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 751.973318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.980516] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1cd567ad-d0d4-428d-ba69-20c122a88913 None None] Enqueued Resource ID: b62dc943-c487-4901-b8f5-8a3805237a00 with Priority: HIGHEST for action port [ 751.980516] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62dc943-c487-4901-b8f5-8a3805237a00 with Priority: HIGHEST for action port [ 751.980516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b62dc943-c487-4901-b8f5-8a3805237a00 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.980516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b62dc943-c487-4901-b8f5-8a3805237a00" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.980827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b62dc943-c487-4901-b8f5-8a3805237a00" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.980827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b62dc943-c487-4901-b8f5-8a3805237a00" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.980908] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62dc943-c487-4901-b8f5-8a3805237a00',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.000440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 752.000590] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 752.000717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.028023] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.028261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.028374] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.028645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.028788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.028950] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port e25ca576-a454-4e7b-9525-66c373db7791 not found, creating... [ 752.029207] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.029362] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.029473] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.029720] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.029800] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.030079] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.030250] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.030365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.030563] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.030692] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.030824] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: e25ca576-a454-4e7b-9525-66c373db7791 is going to be created. [ 752.051995] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.052151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.052265] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.052529] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.052750] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.052967] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.061060] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.158033] env[65119]: INFO networking_nsxv3.common.synchronization [None req-d4191a73-d826-451d-afa8-81a85e6dd775 tempest-ServersV294TestFqdnHostnames-1932911180 tempest-ServersV294TestFqdnHostnames-1932911180-project-member] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 752.158789] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 752.159148] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.159269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.233769] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.233769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.233769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.233769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.233769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.233769] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 already deleted. [ 752.233769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.234094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.234129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.234247] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.483269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b62dc943-c487-4901-b8f5-8a3805237a00 [ 752.483564] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.483710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.483788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.484035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.484545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.484672] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b62dc943-c487-4901-b8f5-8a3805237a00 already deleted. [ 752.484794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b62dc943-c487-4901-b8f5-8a3805237a00" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.563742] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.563896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.563974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.564206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.564300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.564398] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 752.598247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.598423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.598490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.598666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.598921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.609327] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 752.762273] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.762465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.762564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.762776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.762870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.762976] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 already deleted. [ 752.763453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.770806] env[65119]: INFO networking_nsxv3.common.synchronization [req-f98763eb-b54a-4b27-af9f-ddede77ef607 req-71d33edb-219b-4d36-ae6e-c9d67fbdf047 service nova] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_rules [ 752.770806] env[65119]: INFO networking_nsxv3.common.synchronization [req-f98763eb-b54a-4b27-af9f-ddede77ef607 req-71d33edb-219b-4d36-ae6e-c9d67fbdf047 service nova] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 752.771046] env[65119]: INFO networking_nsxv3.common.synchronization [req-f98763eb-b54a-4b27-af9f-ddede77ef607 req-71d33edb-219b-4d36-ae6e-c9d67fbdf047 service nova] Enqueued Resource ID: e25ca576-a454-4e7b-9525-66c373db7791 with Priority: HIGHEST for action port [ 752.771389] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_rules [ 752.772202] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 752.772202] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e25ca576-a454-4e7b-9525-66c373db7791 with Priority: HIGHEST for action port [ 752.772202] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.772202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.772738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.772738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.772738] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.773982] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.773982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.773982] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e25ca576-a454-4e7b-9525-66c373db7791 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.773982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.773982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.775933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.775933] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e25ca576-a454-4e7b-9525-66c373db7791',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.027263] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 753.027585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.276211] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.276211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.280447] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e25ca576-a454-4e7b-9525-66c373db7791 with status ACTIVE [ 753.280788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.280932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.281018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.281277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.281370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.281552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.282074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.282074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.282074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.282074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.282241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.282305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.282373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.282514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.282588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.282696] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e25ca576-a454-4e7b-9525-66c373db7791 is going to be updated. [ 753.319565] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.319565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.319565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.320521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.320792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.321327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e25ca576-a454-4e7b-9525-66c373db7791" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.723186] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.725674] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.725674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.725674] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.229343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.229343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.229343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.229343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.229343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.229343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.229343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.230083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.230083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.230388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.230429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.230547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.230686] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.230773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.230831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.230963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.231052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.231132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.231232] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.333360] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9302997e-8ac3-4415-8fce-c547d8c26ae4 None None] Enqueued Resource ID: 1b15be9a-dd1d-49a1-ad04-bce34e206a74 with Priority: HIGHEST for action port [ 754.334013] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b15be9a-dd1d-49a1-ad04-bce34e206a74 with Priority: HIGHEST for action port [ 754.334463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b15be9a-dd1d-49a1-ad04-bce34e206a74 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.334602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b15be9a-dd1d-49a1-ad04-bce34e206a74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.335011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b15be9a-dd1d-49a1-ad04-bce34e206a74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.335307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b15be9a-dd1d-49a1-ad04-bce34e206a74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.335394] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b15be9a-dd1d-49a1-ad04-bce34e206a74',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.619753] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 754.619991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.620249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.620501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.620701] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.620829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.620900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.621088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.621178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.621281] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.736413] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 754.758552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.760615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.760615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.761288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.788816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.788816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.788816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.788816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.788816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.788816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.788816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.789281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.789281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.789281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.789281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.789479] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.789479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.789822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.789822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.789822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.789822] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 754.837775] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b15be9a-dd1d-49a1-ad04-bce34e206a74 [ 754.838072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.838211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.838290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.838503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.838593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.838697] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b15be9a-dd1d-49a1-ad04-bce34e206a74 already deleted. [ 754.838781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b15be9a-dd1d-49a1-ad04-bce34e206a74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.871172] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.871363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.871363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.871586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.871772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.891665] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 755.124330] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.627381] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.135202] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.135202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.135202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.135202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.135202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.135202] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 756.166949] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.167943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.167943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.167943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.167943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.178873] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 756.434917] env[65119]: INFO networking_nsxv3.common.synchronization [req-16152996-a242-4254-8d0e-24b84a88bcb1 req-b60d0836-936b-4f33-868f-40a8ce6435ee tempest-ServersAdminNegativeTestJSON-1695298807 tempest-ServersAdminNegativeTestJSON-1695298807-project-member] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 756.435474] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGHEST for action security_group_members [ 756.435803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.436177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.436177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.437490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.437490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.437490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.437752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.437752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.437923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.437923] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.910028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 756.910028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.943411] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.943411] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.943411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.943411] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be updated. [ 756.970731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.970885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.970979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.971217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.971360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.982831] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: IN_PROGRESS for 2s [ 757.567841] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c06eed2b-0504-4344-aabb-6b200a1222b9 None None] Enqueued Resource ID: bf0a5e55-3cef-47a5-9474-df0c5eee4af0 with Priority: HIGHEST for action port [ 757.568573] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0a5e55-3cef-47a5-9474-df0c5eee4af0 with Priority: HIGHEST for action port [ 757.568920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0a5e55-3cef-47a5-9474-df0c5eee4af0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.572549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0a5e55-3cef-47a5-9474-df0c5eee4af0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.572689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0a5e55-3cef-47a5-9474-df0c5eee4af0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.572981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0a5e55-3cef-47a5-9474-df0c5eee4af0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.573102] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0a5e55-3cef-47a5-9474-df0c5eee4af0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.667919] env[65119]: INFO networking_nsxv3.common.synchronization [None req-3b53ce92-9c4a-43e1-9e5f-074c7c3be44b None None] Enqueued Resource ID: be95e32f-56ae-43af-89c1-76f3bfa397db with Priority: HIGHEST for action port [ 757.668500] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be95e32f-56ae-43af-89c1-76f3bfa397db with Priority: HIGHEST for action port [ 757.668811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-be95e32f-56ae-43af-89c1-76f3bfa397db taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.668933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be95e32f-56ae-43af-89c1-76f3bfa397db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.669417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be95e32f-56ae-43af-89c1-76f3bfa397db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.669736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be95e32f-56ae-43af-89c1-76f3bfa397db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.670103] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be95e32f-56ae-43af-89c1-76f3bfa397db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.076671] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf0a5e55-3cef-47a5-9474-df0c5eee4af0 [ 758.076996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.077219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.077291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.077503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.077593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.077685] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf0a5e55-3cef-47a5-9474-df0c5eee4af0 already deleted. [ 758.077764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0a5e55-3cef-47a5-9474-df0c5eee4af0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.172596] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be95e32f-56ae-43af-89c1-76f3bfa397db [ 758.173041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.173209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.173285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.173566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.173692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.173812] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be95e32f-56ae-43af-89c1-76f3bfa397db already deleted. [ 758.173933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be95e32f-56ae-43af-89c1-76f3bfa397db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.192041] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 758.192041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.192041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.193677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.193906] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.194071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.194144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.194356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.194481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.194583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.194682] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.305680] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-9199fec0-6627-4d4e-a5d5-cfd735170afc tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 758.305680] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 758.306196] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.306414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.306594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.307521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.307715] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.308055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.308151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.308488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.308488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.308602] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.700328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.700328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.700328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.700328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.700328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.700976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.700976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.700976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.700976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.700976] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.736034] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-3b9b690e-d554-484a-8b51-af587ae1f50e tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 758.736034] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 758.736547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.736855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.816979] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.816979] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.816979] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 already deleted. [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.816979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.818177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.818743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.819207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.819659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.821737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.821737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.821737] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.996315] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59b58cb-0641-49be-856b-56dc606d886a in Status: SUCCESS [ 758.996579] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59b58cb-0641-49be-856b-56dc606d886a deletion is rescheduled due to dependency. [ 758.996650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.123244] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-1ccb55fc-4d32-4dbc-929d-3d0deb423b86 tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 759.124130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 759.124411] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.124515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.203403] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31ff7630-123f-4898-982a-bb6d45f72689: rpc.has_security_group_logging(os_id): False [ 759.228418] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.228544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.228544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.230417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.253396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.253795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.253991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.254122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.254405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.254531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.254817] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.254972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.255085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.255316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.255460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.255735] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.255876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.255972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.256215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.256340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.256473] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 759.322729] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.322729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.322729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.322729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.322729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.324395] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.324395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.324395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.325153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.325153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.325153] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.325153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.325153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.325964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.325964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.325964] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 already deleted. [ 759.325964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.326341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.326341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.326398] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.326557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.326557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.326668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.327354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.327354] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.343777] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 759.443399] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0c3cd9e4-b933-459f-a6a4-4986e13f3102 None None] Enqueued Resource ID: b1a7929d-7cb5-459b-91d9-a03cd658887e with Priority: HIGHEST for action port [ 759.444337] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a7929d-7cb5-459b-91d9-a03cd658887e with Priority: HIGHEST for action port [ 759.446596] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a7929d-7cb5-459b-91d9-a03cd658887e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.446596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a7929d-7cb5-459b-91d9-a03cd658887e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.446596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a7929d-7cb5-459b-91d9-a03cd658887e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.446596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a7929d-7cb5-459b-91d9-a03cd658887e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.446596] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a7929d-7cb5-459b-91d9-a03cd658887e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.513319] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.513524] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.513621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.513952] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.514253] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.514407] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.514521] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.514739] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.514879] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.515098] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.515385] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.515385] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.515476] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.515525] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.515649] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.517089] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.538057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.538301] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.538388] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.538556] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.539197] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-25c07deb-31c0-42c6-b312-3f1277e30e1e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.539197] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.539350] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.539654] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.539790] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c07deb-31c0-42c6-b312-3f1277e30e1e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.829784] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.830099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.830099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.830290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.830371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.830554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.830692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.830762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.831268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.831268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.831268] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 already deleted. [ 759.831268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.948701] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1a7929d-7cb5-459b-91d9-a03cd658887e [ 759.948986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.949164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.949265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.949480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.949599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.949706] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1a7929d-7cb5-459b-91d9-a03cd658887e already deleted. [ 759.949816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a7929d-7cb5-459b-91d9-a03cd658887e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.006338] env[65119]: INFO networking_nsxv3.common.synchronization [req-2a735355-7cd8-4897-b18b-fd9f5e297a9f req-d19e230b-30d1-44ad-b30b-7098ab417b40 tempest-ServerPasswordTestJSON-659254824 tempest-ServerPasswordTestJSON-659254824-project-member] Enqueued Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 760.006975] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 760.007787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.007992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.008071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.008287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.008792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.008937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.009015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.009187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.009277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.009373] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.026954] env[65119]: INFO networking_nsxv3.common.synchronization [None req-423103b5-3728-4f05-b309-b403fce1504a None None] Enqueued Resource ID: 3478984c-024f-492e-81fd-2ce7bd125793 with Priority: HIGHEST for action port [ 760.027469] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3478984c-024f-492e-81fd-2ce7bd125793 with Priority: HIGHEST for action port [ 760.027770] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-3478984c-024f-492e-81fd-2ce7bd125793 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.027982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3478984c-024f-492e-81fd-2ce7bd125793" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.028082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3478984c-024f-492e-81fd-2ce7bd125793" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.028444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3478984c-024f-492e-81fd-2ce7bd125793" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.028531] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3478984c-024f-492e-81fd-2ce7bd125793',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.043258] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.043490] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.043612] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.043891] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.044069] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.044191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 25c07deb-31c0-42c6-b312-3f1277e30e1e not found, creating... [ 760.044454] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.044609] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.044724] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.044950] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.045110] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.045393] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.045543] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.045662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.047188] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.047188] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.047188] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 25c07deb-31c0-42c6-b312-3f1277e30e1e is going to be created. [ 760.073460] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.073983] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.073983] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.074263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.074477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.074726] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.468103] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.468613] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-410" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.471467] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-410" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.471467] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-410" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.472202] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.472202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.472202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.472202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.472202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.472453] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.472678] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.472678] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.472678] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.472791] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.474897] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.474897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.495365] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.495541] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.495678] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.495903] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-410" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.496252] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.496422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.496537] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.496850] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.496987] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd08f67c-3fcd-4138-af9c-d5a51ee5c88f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.513049] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.513049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.513049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.513049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.513572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.513572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.513572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.513572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.513717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.513790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.513902] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373d855b-b953-484c-8b48-75904bb81afd already deleted. [ 760.513959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.530958] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3478984c-024f-492e-81fd-2ce7bd125793 [ 760.531471] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.531471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.531471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.531639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.531672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.534343] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3478984c-024f-492e-81fd-2ce7bd125793 already deleted. [ 760.534343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3478984c-024f-492e-81fd-2ce7bd125793" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-9ded49fb-43ce-49c9-b88e-9b2bd9addb81 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-9ded49fb-43ce-49c9-b88e-9b2bd9addb81 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-9ded49fb-43ce-49c9-b88e-9b2bd9addb81 service nova] Enqueued Resource ID: 25c07deb-31c0-42c6-b312-3f1277e30e1e with Priority: HIGHEST for action port [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 760.837527] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c07deb-31c0-42c6-b312-3f1277e30e1e with Priority: HIGHEST for action port [ 760.838099] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.838099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.838099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.838327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.838327] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.839751] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.839833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.840055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.841324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.841324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.841324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.841324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.841324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.841324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.841324] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.842057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-25c07deb-31c0-42c6-b312-3f1277e30e1e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.843267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.843402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.843985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.843985] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c07deb-31c0-42c6-b312-3f1277e30e1e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.999784] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.000049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.000189] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.000468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.000620] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.000760] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port dd08f67c-3fcd-4138-af9c-d5a51ee5c88f not found, creating... [ 761.001043] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.001206] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.001322] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.001548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.001681] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.002022] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.003536] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.003702] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.003960] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.004123] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.004269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: dd08f67c-3fcd-4138-af9c-d5a51ee5c88f is going to be created. [ 761.030866] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.031101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.031242] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.031530] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.031755] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.031980] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.237480] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 761.237929] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 761.238961] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 761.238961] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 761.238961] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.238961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.239670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.239855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.242179] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.242179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.242179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.242179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.242179] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.293041] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 761.293041] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 761.293634] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_rules [ 761.293991] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 761.294306] env[65119]: INFO networking_nsxv3.common.synchronization [req-a13c44e3-4c63-4284-9a38-e0dc2103231f req-39263e9e-381f-4499-a107-404ca954fb04 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 761.297207] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 761.297207] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_rules [ 761.297207] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 761.297207] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 761.297207] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 761.297207] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.297207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.297207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.297207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.297207] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.297673] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.298009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.299026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.299026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.299026] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.301180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.301180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.301180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.301180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.302758] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b5471f-a83a-4bf7-9bce-39ffdeee0562',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.303803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.304868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.304868] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.304868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.346134] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.348074] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.349515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.351063] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25c07deb-31c0-42c6-b312-3f1277e30e1e with status ACTIVE [ 761.351063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.351063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.351063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.351063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.351063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.351063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.351357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.351357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.351357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.351447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.351620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.351721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.351787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.351951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.351951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.352128] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25c07deb-31c0-42c6-b312-3f1277e30e1e is going to be updated. [ 761.375579] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 761.375579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.381802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.381948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.382042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.382263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.383188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.383188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25c07deb-31c0-42c6-b312-3f1277e30e1e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.745215] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.746301] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.770918] env[65119]: INFO networking_nsxv3.common.synchronization [req-2a735355-7cd8-4897-b18b-fd9f5e297a9f req-17468c3f-d92b-44a2-8117-9571ba582a78 service nova] Enqueued Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_rules [ 761.772026] env[65119]: INFO networking_nsxv3.common.synchronization [req-2a735355-7cd8-4897-b18b-fd9f5e297a9f req-17468c3f-d92b-44a2-8117-9571ba582a78 service nova] Enqueued Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 761.772026] env[65119]: INFO networking_nsxv3.common.synchronization [req-2a735355-7cd8-4897-b18b-fd9f5e297a9f req-17468c3f-d92b-44a2-8117-9571ba582a78 service nova] Enqueued Resource ID: dd08f67c-3fcd-4138-af9c-d5a51ee5c88f with Priority: HIGHEST for action port [ 761.772026] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_rules [ 761.772026] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 761.772026] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd08f67c-3fcd-4138-af9c-d5a51ee5c88f with Priority: HIGHEST for action port [ 761.772506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.772506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.772506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.772681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.772768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.773570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.773997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.774185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.774951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.774951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.774951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.774951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.774951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.774951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.774951] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.777787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.777787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.777787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.777787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.777787] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd08f67c-3fcd-4138-af9c-d5a51ee5c88f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.801636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.801764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.805688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.805832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.806176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with status ACTIVE [ 761.806353] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.806461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.806523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.806723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.806806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.807013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.807080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.807140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.807286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.807359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.807528] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.807790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.807790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.807991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.807991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.807991] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 is going to be updated. [ 761.832696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.832887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.832887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.833104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.833245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.833412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.850927] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.161131] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.161816] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-303" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.161816] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-303" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.161816] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-303" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.162017] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.162275] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.162369] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.162614] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.162752] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163686] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.163686] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.163686] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.163686] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.163686] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.163686] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.163686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.192537] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.193210] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.193489] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.193684] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-303" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.194077] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.194290] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.194434] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.195302] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.195469] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9bd853-2907-4b22-aa1b-94c5a1f14a8f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.248452] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.249659] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.279189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.279189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.279310] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.280342] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd08f67c-3fcd-4138-af9c-d5a51ee5c88f with status ACTIVE [ 762.280504] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.280634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.280707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.280913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.281071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.281469] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.281469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.281469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.281679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.281679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.281813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.281941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.281980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.282138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.282211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.282896] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd08f67c-3fcd-4138-af9c-d5a51ee5c88f is going to be updated. [ 762.307196] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.307323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.307407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.307663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.307892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.308966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd08f67c-3fcd-4138-af9c-d5a51ee5c88f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.354754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.354908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.355061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.355476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.355564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.357320] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be created. [ 762.387780] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.387901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.387956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.388221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.388434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.401424] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: UNINITIALIZED for 2s [ 762.412465] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b17a4f8f-6a0b-45bd-91c4-3b4e915d56b6 None None] Enqueued Resource ID: 1831ce38-b963-4f92-9bae-2a02517798af with Priority: HIGHEST for action port [ 762.413147] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1831ce38-b963-4f92-9bae-2a02517798af with Priority: HIGHEST for action port [ 762.413561] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1831ce38-b963-4f92-9bae-2a02517798af taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.413712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1831ce38-b963-4f92-9bae-2a02517798af" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.413855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1831ce38-b963-4f92-9bae-2a02517798af" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.416664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1831ce38-b963-4f92-9bae-2a02517798af" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.416788] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1831ce38-b963-4f92-9bae-2a02517798af',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.697723] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.698102] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.698295] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.698596] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.698751] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.698920] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f not found, creating... [ 762.699359] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.699481] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.699540] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.699788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.699923] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.700301] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.700474] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.700591] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.700812] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.700947] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.701143] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f is going to be created. [ 762.721617] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.721880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.722016] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.722294] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.722520] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.722740] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.752032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.752032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.752032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.752032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.752032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.752739] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 762.753602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.753735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.753818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.753993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.754144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.754188] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be created. [ 762.784959] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.816448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.816638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.816687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.816897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.817284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.852431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: UNINITIALIZED for 2s [ 762.856138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.856138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.856138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.882480] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 762.919024] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1831ce38-b963-4f92-9bae-2a02517798af [ 762.919281] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.919479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.919479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.919723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.919805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.919876] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1831ce38-b963-4f92-9bae-2a02517798af already deleted. [ 762.919959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1831ce38-b963-4f92-9bae-2a02517798af" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.287377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.287377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.287377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.287709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.287709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.287709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373d855b-b953-484c-8b48-75904bb81afd is going to be created. [ 763.313375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.313375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.313375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.313674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.313856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.326086] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: UNINITIALIZED for 2s [ 763.545657] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-67698c42-523d-4372-b8f4-21b0281754f0 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 763.545657] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-67698c42-523d-4372-b8f4-21b0281754f0 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 763.545657] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-67698c42-523d-4372-b8f4-21b0281754f0 service nova] Enqueued Resource ID: 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f with Priority: HIGHEST for action port [ 763.549927] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 763.549927] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 763.549927] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f with Priority: HIGHEST for action port [ 763.549927] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.549927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.549927] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.549927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.549927] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.549927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.549927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.549927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.549927] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9bd853-2907-4b22-aa1b-94c5a1f14a8f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.053677] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f with status ACTIVE [ 764.053677] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.054022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.054022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.054100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.054194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.054370] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.054761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.054761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.054761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.054761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.054977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.055054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.055272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.055272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.055369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.055401] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e9bd853-2907-4b22-aa1b-94c5a1f14a8f is going to be updated. [ 764.087206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.087306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.087340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.087799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.087799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.087963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e9bd853-2907-4b22-aa1b-94c5a1f14a8f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.417491] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.417491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.417491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.417491] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.419483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.419752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.419954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.420380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.420495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.420822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.420822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.420938] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.469685] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.469685] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.469685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.470053] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.470053] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.470053] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.470141] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.470245] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.470357] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.470519] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.495062] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.495245] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.495245] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.495418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-180" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.495890] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-0758bd5b-eaf1-4414-950c-277e8a0060b9 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.496101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.496101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.496411] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.496552] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0758bd5b-eaf1-4414-950c-277e8a0060b9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.875210] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.875210] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.875210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.875210] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.896022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.896022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.896022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.896022] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.926351] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.926351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.926351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.999539] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.999806] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.999943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.000271] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.000437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.000591] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 0758bd5b-eaf1-4414-950c-277e8a0060b9 not found, creating... [ 765.000853] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.001014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.001153] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.001384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.001519] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.001798] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.001948] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.002206] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.002535] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.002733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.002918] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 0758bd5b-eaf1-4414-950c-277e8a0060b9 is going to be created. [ 765.025748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.026183] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.026437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.026921] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.027306] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.027722] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.337997] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: SUCCESS [ 765.338499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.338499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.338640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.338826] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.338940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.339012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.339175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.339246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.339336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.339427] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.376716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.397962] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.428681] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.756732] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-2f35afe6-4fe4-44a7-852b-f457bb91fa60 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 765.756860] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-2f35afe6-4fe4-44a7-852b-f457bb91fa60 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 765.756998] env[65119]: INFO networking_nsxv3.common.synchronization [req-5e259532-e3f3-44a2-a647-2f44c5ff54ed req-2f35afe6-4fe4-44a7-852b-f457bb91fa60 service nova] Enqueued Resource ID: 0758bd5b-eaf1-4414-950c-277e8a0060b9 with Priority: HIGHEST for action port [ 765.757531] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 765.757672] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 765.757923] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0758bd5b-eaf1-4414-950c-277e8a0060b9 with Priority: HIGHEST for action port [ 765.758372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.758565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.758730] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.758851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.759082] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0758bd5b-eaf1-4414-950c-277e8a0060b9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.759203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.759244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.759497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.759610] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0758bd5b-eaf1-4414-950c-277e8a0060b9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.845903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.845903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.845903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.845903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.845903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.847891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.847891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.847891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.847891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.847891] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.881029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.900902] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.930984] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.931141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.931218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.931445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.931543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.931719] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 765.965424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.965577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.965650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.965863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.966126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.977669] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 766.072124] env[65119]: INFO networking_nsxv3.common.synchronization [req-84bb6666-567a-4188-b589-571fc55e9c7b req-9810e2d0-f204-4655-8cee-914ee3b2a482 tempest-FloatingIPsAssociationNegativeTestJSON-2122394855 tempest-FloatingIPsAssociationNegativeTestJSON-2122394855-project-member] Enqueued Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 766.072124] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 766.072124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.072124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.072124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.072678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.072959] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.074720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.074720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.074720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.074720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.074720] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.262479] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0758bd5b-eaf1-4414-950c-277e8a0060b9 with status ACTIVE [ 766.262737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.266754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.266754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.266754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.266754] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0758bd5b-eaf1-4414-950c-277e8a0060b9 is going to be updated. [ 766.298161] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.299043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.299688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.300302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.300555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.300796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0758bd5b-eaf1-4414-950c-277e8a0060b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.349399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 373d855b-b953-484c-8b48-75904bb81afd: rpc.has_security_group_logging(os_id): False [ 766.372081] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.372312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.372312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.372530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.372611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.372909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.372909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.373091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.373154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.373200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.373390] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.373488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.373665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.374215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.374215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.374385] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.374478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.374478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.374915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.374915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.374915] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373d855b-b953-484c-8b48-75904bb81afd is going to be created. [ 766.385859] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.385859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.385859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.385859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.386184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.386368] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be updated. [ 766.404086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.404086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.404086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.404086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.404086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.404086] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 766.430929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.430929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.430929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.430929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.430929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.462556] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 766.472011] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.472134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.472190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.472422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.472672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.490114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.490483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.490601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.490852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.491018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.497298] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: IN_PROGRESS for 2s [ 766.506249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 766.575622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.575814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.575883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.576150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.576248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.576517] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.576684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.576755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.577044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.577044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.577192] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 already deleted. [ 766.577296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.032392] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-321 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.032642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-321" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.032848] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-321" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.033269] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-321" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.034050] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.034314] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.034515] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.034798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.034990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.035273] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.035411] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.035976] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.036524] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.037020] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.037020] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.037020] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.059400] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.060364] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.060364] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.060364] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-321" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.060364] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.060675] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.060675] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.060865] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.061752] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1786a5-16ef-4365-bf0a-c4eeb7a89251',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.563798] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.564104] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.564263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.564455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.564608] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.564760] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 not found, creating... [ 767.565017] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.565175] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.565338] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.565502] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.565636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.565918] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.566225] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.566225] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.566405] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.566532] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.566664] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 is going to be created. [ 767.591176] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.591176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.591176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.591176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.591176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.591176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.873067] env[65119]: INFO networking_nsxv3.common.synchronization [req-e516c00e-f1a9-4060-8ac9-946ae44afb36 req-ad99d0b4-4162-4244-a27b-36756f28db98 tempest-ServerMetadataTestJSON-45433866 tempest-ServerMetadataTestJSON-45433866-project-member] Enqueued Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 767.873723] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGHEST for action security_group_members [ 767.876050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.876239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.876320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.876489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.876674] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.876788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.876869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.876941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.877025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.877137] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.992216] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 767.992216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.992216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.992216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.992573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.992573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.992697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.992816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.992920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.993529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.993529] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.993529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.993529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.993529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.993913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.993913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.993913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.993913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.994075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.994075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.994141] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.995281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.995381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.995556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.995928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.995928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.995928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.996078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.996109] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.328567] env[65119]: INFO networking_nsxv3.common.synchronization [req-84bb6666-567a-4188-b589-571fc55e9c7b req-ca9fdd3b-fe69-4fce-be62-aa9d06319c15 service nova] Enqueued Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_rules [ 768.328782] env[65119]: INFO networking_nsxv3.common.synchronization [req-84bb6666-567a-4188-b589-571fc55e9c7b req-ca9fdd3b-fe69-4fce-be62-aa9d06319c15 service nova] Enqueued Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 768.328889] env[65119]: INFO networking_nsxv3.common.synchronization [req-84bb6666-567a-4188-b589-571fc55e9c7b req-ca9fdd3b-fe69-4fce-be62-aa9d06319c15 service nova] Enqueued Resource ID: 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 with Priority: HIGHEST for action port [ 768.329442] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_rules [ 768.329924] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 768.330061] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 with Priority: HIGHEST for action port [ 768.330346] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.330464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.330523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.330790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.330866] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.331740] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.331861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.332028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.332113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.332259] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.332352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.332413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.332547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.332633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.332722] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.336118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.336275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.336308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.336456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.336529] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1786a5-16ef-4365-bf0a-c4eeb7a89251',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.360664] env[65119]: INFO networking_nsxv3.common.synchronization [req-6da5d4d6-30d2-4bf7-9c85-1701edfa875d req-6b56205c-55e6-4f80-a2da-04fee3afbaeb tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 768.362066] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 768.362168] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.362241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.362296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.363897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.363897] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.363897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.363897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.363897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.363897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.363897] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.379621] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.379785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.379859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.380490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.380490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.384807] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.384807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.384807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.384807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.384807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.384807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 is going to be updated. [ 768.421296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.421434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.421512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.421748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.421892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.434170] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: IN_PROGRESS for 2s [ 768.473375] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 768.473694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.474133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.474358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.474586] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.474690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.474725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.474876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.474959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.475063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.475155] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.499089] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d044d815-6af5-4fd9-a0b1-bc64182a7697: rpc.has_security_group_logging(os_id): False [ 768.499962] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.514661] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: SUCCESS [ 768.515029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.516299] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 768.516595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.516689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.516847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.517048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.517184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.517259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.517444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.517529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.517616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.517726] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.519417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.519535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.519604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.519761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.519845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.520026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.520134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.520197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.520339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.520415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.520615] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.520711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.520773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.520911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.520987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.521189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.521283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.521344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.521511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.521598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.521683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be created. [ 768.580558] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.580886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.580886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.580886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.581075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.594543] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 768.838962] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.839211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.839523] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.840561] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 with status ACTIVE [ 768.840667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.840815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.840815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.841057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.841222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.841451] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.841569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.841635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.845024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.845024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.845024] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a1786a5-16ef-4365-bf0a-c4eeb7a89251 is going to be updated. [ 768.867548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.867548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.867548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.867548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.867548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.867844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a1786a5-16ef-4365-bf0a-c4eeb7a89251" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.867844] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.964494] env[65119]: INFO networking_nsxv3.common.synchronization [req-ed277229-15ce-411c-a58d-0f615f940786 req-82812fff-0bbf-4e49-84fb-c29049f9faad tempest-ServersTestJSON-1698246118 tempest-ServersTestJSON-1698246118-project-member] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 768.965210] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 768.965532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.965690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.965762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.965956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.966123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.966227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.966418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.966543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.966543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.966638] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.978801] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.002387] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.025222] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.025384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.025458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.025658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.026226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.026226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.026226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.026226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.026226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.026431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.026467] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.026763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.026763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.026763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.026883] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.026929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.027080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.027143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.027189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.028076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.028076] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.309517] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6676a047-aca2-4823-970f-dfd0ce85d12b tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 769.310954] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 769.310954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.310954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.310954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.310954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.310954] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.336571] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.336571] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.336806] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.337063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.337325] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.337574] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.337696] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.338389] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.338389] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.338571] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.339102] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.339336] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.339384] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.339479] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.339567] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.339706] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.344443] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.362085] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.362343] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.362866] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.362866] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.363107] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-1bedd485-fc19-4385-8720-67f45f15f6bd taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.363349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.363478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.364096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.364096] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bedd485-fc19-4385-8720-67f45f15f6bd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.372262] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.450476] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e3e7d1b3-4b3b-47ce-8e0e-f9126da9c7a7 tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 769.451817] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 769.451817] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.451817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.470471] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.470622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.472017] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.472017] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 already deleted. [ 769.472017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.481758] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a123fbf6-102f-4574-bd53-22fcf6ab3da8: rpc.has_security_group_logging(os_id): False [ 769.502326] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.502550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.502550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.502759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.502845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.503420] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.503550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.503940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.503940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.503940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.503940] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be created. [ 769.505236] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.505348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.505348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.505493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.505614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.505769] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 769.529474] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 769.540857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.540857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.540857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.541387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.541547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.553125] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 769.554357] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.554357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.554357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.554610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.554610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.554745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.554909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.554909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.555100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.555184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.555990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.555990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.555990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.555990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.555990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.555990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.556485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.556485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.556485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.556485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.556485] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 769.561846] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.562017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.562059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.563221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.563221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.577377] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 769.642745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.643085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.643085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.644414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.644574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.680040] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 769.832853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.832976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.833062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.833310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.833551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.833666] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 already deleted. [ 769.833757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.833906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.834090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.834175] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.846405] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.846872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.847028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.847314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.847419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.847501] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 is going to be created. [ 769.868622] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.872982] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 1bedd485-fc19-4385-8720-67f45f15f6bd not found, creating... [ 769.872982] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.872982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.873331] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.873331] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.873552] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.873943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.874218] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.874969] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 1bedd485-fc19-4385-8720-67f45f15f6bd is going to be created. [ 769.876123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.876217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.876254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.876428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.876496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.876586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 769.878605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.878727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.878773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.878936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.879099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.894634] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: UNINITIALIZED for 2s [ 769.914167] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.914417] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.914487] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.914767] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.914995] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.915232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.919745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.919900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.919943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.920171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.920317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.931760] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 770.359948] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.360255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.360365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.360595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.360686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.360819] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 already deleted. [ 770.360909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.452887] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 in Status: SUCCESS [ 770.453161] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 deletion is rescheduled due to dependency. [ 770.453290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.610220] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 770.610442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.610625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.610918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.611028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.640707] env[65119]: INFO networking_nsxv3.common.synchronization [req-ed277229-15ce-411c-a58d-0f615f940786 req-88176dd7-2e9d-45f2-9372-d956e4ae0604 service nova] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 770.640707] env[65119]: INFO networking_nsxv3.common.synchronization [req-ed277229-15ce-411c-a58d-0f615f940786 req-88176dd7-2e9d-45f2-9372-d956e4ae0604 service nova] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 770.640707] env[65119]: INFO networking_nsxv3.common.synchronization [req-ed277229-15ce-411c-a58d-0f615f940786 req-88176dd7-2e9d-45f2-9372-d956e4ae0604 service nova] Enqueued Resource ID: 1bedd485-fc19-4385-8720-67f45f15f6bd with Priority: HIGHEST for action port [ 770.641574] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_rules [ 770.641718] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 770.641718] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bedd485-fc19-4385-8720-67f45f15f6bd with Priority: HIGHEST for action port [ 770.642782] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.642782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.642782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.642782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.642782] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.643443] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.643552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.643615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.643777] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.643943] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.644055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.644121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.644365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.644476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.644516] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.645247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bedd485-fc19-4385-8720-67f45f15f6bd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.645349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.645412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.645560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.645632] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bedd485-fc19-4385-8720-67f45f15f6bd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.115512] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.115681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.147450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.147450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.148578] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.149505] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bedd485-fc19-4385-8720-67f45f15f6bd with status ACTIVE [ 771.149728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.149869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.149954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.152037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.152037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.153037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.153037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.153037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.153037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153277] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.153326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.153834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.153834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.153834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153834] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bedd485-fc19-4385-8720-67f45f15f6bd is going to be updated. [ 771.182906] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.183085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.183145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.183343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.183484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.183646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bedd485-fc19-4385-8720-67f45f15f6bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.486023] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:0 completed [ 771.486023] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:1 started [ 771.564119] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 771.564335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.564932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.564932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.564932] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.565141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.565141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.565211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.565296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.565380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.565478] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.604627] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 771.604839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.658071] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.703250] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 771.703517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.905232] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: SUCCESS [ 771.905457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.905656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.905951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.906187] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.906318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.906723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.907014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.907142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.907467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.907467] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.941440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 771.941713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.069783] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.070006] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.070111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.070402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.070588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.070716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.070777] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.071257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.071257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.071257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.071438] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.071438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.071558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.071613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.071790] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.071884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.071938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.072116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.072212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.072266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.072362] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.163026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.163026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.163026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.163026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.163026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.163026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 is going to be created. [ 772.190356] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.190566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.190631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.194258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.194258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.202149] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: UNINITIALIZED for 2s [ 772.412601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.412601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.412601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.412601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.412601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.414128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.414128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.414128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.414128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.414128] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.578059] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d044d815-6af5-4fd9-a0b1-bc64182a7697: rpc.has_security_group_logging(os_id): False [ 772.597299] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.597460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.597536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.597761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.597869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.598276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.598415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.598503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.598707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.598822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.599080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.599211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.599298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.600447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.600447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.600447] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 772.681608] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.682035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.682035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.682156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.682320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.695901] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 772.917851] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93a8142-3940-4c00-a52e-9490a9ce5342: rpc.has_security_group_logging(os_id): False [ 772.958763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.958910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.959024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.959280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.959381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.959773] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.959773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.959773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.960031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.960031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.960507] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.960507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.960507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.960507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.960832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.960832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.960832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.960946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.961423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.961526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.961623] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 is going to be created. [ 773.123023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.123023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.123023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.123023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.123023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.136267] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: IN_PROGRESS for 2s [ 773.408620] env[65119]: INFO networking_nsxv3.common.synchronization [req-572b65cc-7edc-4c08-90ff-924e7b1bd304 req-968c10be-70c2-4485-950b-86c33a04012f tempest-ServersTestFqdnHostnames-1879836506 tempest-ServersTestFqdnHostnames-1879836506-project-member] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 773.409145] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 773.410696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.411726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.411726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.411726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.411726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.411726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.411726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.412162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.412162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.412432] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.817842] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.818221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-902" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.818273] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-902" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.818569] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-902" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.818820] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.818974] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.819593] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.819827] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.819971] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.820328] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.820450] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.820556] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.820658] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.820762] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.820862] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.821025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.839752] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.839927] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.840069] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.840452] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-902" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.840704] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-07211da5-631f-4662-b6aa-e6893d150277 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.840876] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.841019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.841346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.841483] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07211da5-631f-4662-b6aa-e6893d150277',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.915049] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.915274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.915374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.915644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.915765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.916039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.916305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.916305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.916451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.916693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.916693] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 already deleted. [ 773.916854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.935699] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 773.935870] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 773.935870] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 773.936371] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 773.936621] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 773.936665] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 773.936994] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.937139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.937139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.937377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.937516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.937619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.937665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.937806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.937892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.937988] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.938947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.939115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.939827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.939827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.939827] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.939827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.939827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.939827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.940110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.940110] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.940826] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df96746-b67b-4d06-9916-684e3d836127 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.941641] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.941641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.941961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.941961] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.978670] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 773.978846] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 773.978976] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_rules [ 773.979128] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 773.979271] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_rules [ 773.979396] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 773.979517] env[65119]: INFO networking_nsxv3.common.synchronization [req-f95c348b-fc50-4f39-a7da-7854056c171b req-b5c8ff45-193c-489f-89f7-05def23b62c2 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 773.980079] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_rules [ 773.980159] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_rules [ 773.980234] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 773.980329] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with Priority: HIGHEST for action port [ 773.980417] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_rules [ 773.980506] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 773.980592] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 773.981099] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.981224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.981292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.981487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.981565] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.982378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3df96746-b67b-4d06-9916-684e3d836127 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.982523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.982561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.982759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.982834] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.984808] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984808] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.984808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984808] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b5471f-a83a-4bf7-9bce-39ffdeee0562',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.985185] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.985185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.985503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.985503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.985503] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.986527] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.986635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.986801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df96746-b67b-4d06-9916-684e3d836127 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.986885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.152236] env[65119]: INFO networking_nsxv3.common.synchronization [req-817f24bb-2dac-4b5e-92d2-1e054c9eec74 req-30971204-75f1-4e3e-9bac-8dd0632b1a50 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 774.152986] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 774.153454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.153631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.153733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.154036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.154278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.154431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.154532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.154753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.154886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.155044] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.213956] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: SUCCESS [ 774.214312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.214512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.214715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.214910] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.215040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.215111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.215266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.215345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.215430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.215646] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.344658] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.344975] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.345138] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.345430] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.345572] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.345722] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 07211da5-631f-4662-b6aa-e6893d150277 not found, creating... [ 774.346021] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.346170] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.346279] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.346504] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.346767] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.346917] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.347074] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.347181] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.347383] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.347506] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.347642] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 07211da5-631f-4662-b6aa-e6893d150277 is going to be created. [ 774.369170] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.369926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.370417] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.370417] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.370666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.370915] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.443365] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.445545] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.448837] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.489250] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df96746-b67b-4d06-9916-684e3d836127 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.489250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.489393] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.489452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.489652] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b5471f-a83a-4bf7-9bce-39ffdeee0562 with status ACTIVE [ 774.489837] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.489987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.490079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.490367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.490484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.490697] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.490801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.490906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.491114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.491222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.491441] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.491573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.491625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.491810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.491909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.492039] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b5471f-a83a-4bf7-9bce-39ffdeee0562 is going to be updated. [ 774.497657] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.497657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.525270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.525470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.525537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.525809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.525968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.526259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b5471f-a83a-4bf7-9bce-39ffdeee0562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.658850] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.660271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.660271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.660271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.660271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.660271] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.660590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.660629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.660924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.661107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.662041] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 774.700045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.700166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.700166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.700401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.700896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.708124] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 774.708124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.708312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.708387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.708478] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.710744] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 774.718480] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.951196] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.952790] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.953612] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.136996] env[65119]: INFO networking_nsxv3.common.synchronization [req-572b65cc-7edc-4c08-90ff-924e7b1bd304 req-17d655dc-0e8d-4a99-80a9-7b8caa7b4496 service nova] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 775.137631] env[65119]: INFO networking_nsxv3.common.synchronization [req-572b65cc-7edc-4c08-90ff-924e7b1bd304 req-17d655dc-0e8d-4a99-80a9-7b8caa7b4496 service nova] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 775.137631] env[65119]: INFO networking_nsxv3.common.synchronization [req-572b65cc-7edc-4c08-90ff-924e7b1bd304 req-17d655dc-0e8d-4a99-80a9-7b8caa7b4496 service nova] Enqueued Resource ID: 07211da5-631f-4662-b6aa-e6893d150277 with Priority: HIGHEST for action port [ 775.140056] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_rules [ 775.140306] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 775.140406] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07211da5-631f-4662-b6aa-e6893d150277 with Priority: HIGHEST for action port [ 775.140968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.140968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.141178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.141309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.141435] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.142863] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.143053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.143174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.143458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.143883] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.143971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.144159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.144400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.144532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.144679] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.151083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-07211da5-631f-4662-b6aa-e6893d150277 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.151083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.151083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.152496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.152496] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07211da5-631f-4662-b6aa-e6893d150277',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.165103] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: SUCCESS [ 775.165345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.212197] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.212197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.212197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.212457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.212634] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.212634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.212754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.212820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.212909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.212993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.213129] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.221158] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed152bbd-2522-4d15-9d17-a181bc283606: rpc.has_security_group_logging(os_id): False [ 775.240524] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.240756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.240868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.241141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.241242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.241552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.241661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.241739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.241914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.241995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.242098] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 is going to be created. [ 775.313123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.313342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.313342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.313695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.313901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.327197] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: IN_PROGRESS for 2s [ 775.454056] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.454309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.454422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.454787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.454872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.454994] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be updated. [ 775.457087] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.457302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.457425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.458050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.458050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.458249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 775.460288] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.460555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.460677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.460977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.461131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.461380] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df96746-b67b-4d06-9916-684e3d836127 is going to be created. [ 775.501166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.501166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.501166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.501441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.501664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.512921] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.513173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.513173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.513421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.513605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.515554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.515690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.515732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.515923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.516067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.524682] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df96746-b67b-4d06-9916-684e3d836127 in Status: UNINITIALIZED for 2s [ 775.526518] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 775.527184] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 775.654231] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.654711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.654711] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.656097] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07211da5-631f-4662-b6aa-e6893d150277 with status ACTIVE [ 775.656097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.656097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.656306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.656466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.656574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.656891] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.659677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.659677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.659890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.659953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.660212] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.660364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.660422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.660754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.660813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.661036] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07211da5-631f-4662-b6aa-e6893d150277 is going to be updated. [ 775.694032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.694032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.694032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.694032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.695152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07211da5-631f-4662-b6aa-e6893d150277" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.715698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.718965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.718965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.718965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.718965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.719702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.719702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.719702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.719702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.719702] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.845466] env[65119]: INFO networking_nsxv3.common.synchronization [req-71648395-656a-4fd6-a6e4-19341bb67d8d req-14d8cb39-457b-442f-8292-da36c2037f6c tempest-ServerMetadataNegativeTestJSON-525433860 tempest-ServerMetadataNegativeTestJSON-525433860-project-member] Enqueued Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 775.847021] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGHEST for action security_group_members [ 775.847262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.847410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.847499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.847768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.847954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.848191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.848282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.848534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.848695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.848840] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.165155] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.225376] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d044d815-6af5-4fd9-a0b1-bc64182a7697: rpc.has_security_group_logging(os_id): False [ 776.247587] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.247763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.247802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.249020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.249020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.249020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.249416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.249416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.249416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.249566] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.249622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.249687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.249824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.249896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.249978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 776.318079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.318079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.318079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.318317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.318467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.340028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 776.356766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.357007] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.357118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.357370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.357524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.357723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.357854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.357943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.359206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.359206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.359206] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 is going to be updated. [ 776.408445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.408445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.408702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.408738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.409113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.421676] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: IN_PROGRESS for 2s [ 776.668179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.668449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.668515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.668804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.668941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.669143] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 is going to be created. [ 776.697605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.697799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.697864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.698206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.698450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.715069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: UNINITIALIZED for 2s [ 776.721622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 776.721870] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 776.721969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.342552] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: SUCCESS [ 777.342912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.539191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 777.539444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.539643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.539861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.540070] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.540194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.540262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.540410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.543042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.543042] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.544186] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 777.544397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.545089] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df96746-b67b-4d06-9916-684e3d836127 in Status: SUCCESS [ 777.545255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.545440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.545686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.545867] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.545979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.546093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.546320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.546420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.546519] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.549492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.549676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.549851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.549970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.550054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.550203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.550303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.550399] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.943165] env[65119]: INFO networking_nsxv3.common.synchronization [req-b60cf51d-31a6-452e-95be-57aba6337a80 req-cda1c424-17a4-4e40-a397-243532dbe393 tempest-ServerPasswordTestJSON-659254824 tempest-ServerPasswordTestJSON-659254824-project-member] Enqueued Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 777.943165] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGHEST for action security_group_members [ 777.943684] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.943684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.943684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.943874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.944028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.944118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.944168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.944315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.944395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.944490] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.054566] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.054566] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.054566] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.356288] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 778.356676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.364385] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e8ce1a5-a33c-445f-a3cb-ee38189015e2 req-fa5e0764-c0ed-47e1-9dde-92bfb262a33b tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 778.364646] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e8ce1a5-a33c-445f-a3cb-ee38189015e2 req-fa5e0764-c0ed-47e1-9dde-92bfb262a33b tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 778.364869] env[65119]: INFO networking_nsxv3.common.synchronization [req-8e8ce1a5-a33c-445f-a3cb-ee38189015e2 req-fa5e0764-c0ed-47e1-9dde-92bfb262a33b tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 778.365660] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGHEST for action security_group_members [ 778.365806] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 778.365916] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df96746-b67b-4d06-9916-684e3d836127 with Priority: HIGHEST for action security_group_members [ 778.366375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.366536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.366914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.367071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.367388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-3df96746-b67b-4d06-9916-684e3d836127 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.367550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.437965] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09eeb8ed-53fe-4534-ba39-d93429300967 in Status: SUCCESS [ 778.438242] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 deletion is rescheduled due to dependency. [ 778.438303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.447974] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.449045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.449045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.449045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.449045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.449045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.449391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.449391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.449391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.449391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.449522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373d855b-b953-484c-8b48-75904bb81afd is going to be updated. [ 778.483842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.484153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.484289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.484640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.484895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.495724] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: IN_PROGRESS for 2s [ 778.558110] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.559013] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.559917] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.727215] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: SUCCESS [ 778.727431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.727665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.727938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.728233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.728357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.728414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.728580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.728681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.728767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.728958] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.061728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.061877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.061961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.067781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.067781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.067781] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be updated. [ 779.067934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.068226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.068226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.068375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.069136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.069136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 779.069722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.069838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.069905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.070690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.070690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.070690] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df96746-b67b-4d06-9916-684e3d836127 is going to be updated. [ 779.109423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.109566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.109658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.109884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.110044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.111942] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.112968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.113137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.113446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.113674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.116240] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.116390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.116433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.116598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.116731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.129507] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df96746-b67b-4d06-9916-684e3d836127 in Status: IN_PROGRESS for 2s [ 779.130212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 779.130773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 779.232425] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.734819] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1faaf9f-2e81-4209-bb0c-5887f3619279: rpc.has_security_group_logging(os_id): False [ 779.754866] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.755030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.755074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.755277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.755369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.755624] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.755731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.755784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.756019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.756019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.756019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 is going to be created. [ 779.821677] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.821934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.821934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.822113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.822299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.863089] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: IN_PROGRESS for 2s [ 780.507313] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373d855b-b953-484c-8b48-75904bb81afd in Status: SUCCESS [ 780.507696] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373d855b-b953-484c-8b48-75904bb81afd deletion is rescheduled due to dependency. [ 780.507696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.100216] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e836e870-e4b2-4834-8f46-efecde7efb33 None None] Enqueued Resource ID: 7cb495ea-83b0-4eac-8345-dc5846da9c74 with Priority: HIGHEST for action port [ 781.100792] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb495ea-83b0-4eac-8345-dc5846da9c74 with Priority: HIGHEST for action port [ 781.101114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cb495ea-83b0-4eac-8345-dc5846da9c74 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.101248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cb495ea-83b0-4eac-8345-dc5846da9c74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.101333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cb495ea-83b0-4eac-8345-dc5846da9c74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.101660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cb495ea-83b0-4eac-8345-dc5846da9c74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.101768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cb495ea-83b0-4eac-8345-dc5846da9c74',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.145651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 781.145898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.146137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.146510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.146661] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.146785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.146955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.147188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.147281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.147373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.147476] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.149255] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3df96746-b67b-4d06-9916-684e3d836127 in Status: SUCCESS [ 781.149401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.150151] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 781.150323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.150736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.150919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.151109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.151224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.151290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.152273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.152391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.152773] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.154680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.155604] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.155604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.155926] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.158046] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.158046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.158489] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.159565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.160347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.160347] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.160347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.160347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.160347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.160551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.162213] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.162414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.162650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.162876] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.163013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.164159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.168259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.168383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.168425] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.604589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cb495ea-83b0-4eac-8345-dc5846da9c74 [ 781.604589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.604775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.604775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.605024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.605191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.605265] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cb495ea-83b0-4eac-8345-dc5846da9c74 already deleted. [ 781.605342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cb495ea-83b0-4eac-8345-dc5846da9c74" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.660661] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.660896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.660985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.661292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.661451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.661663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.661773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.661864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.662194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.662284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.662381] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be updated. [ 781.663602] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3df96746-b67b-4d06-9916-684e3d836127',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.664620] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.670147] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.670360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.670689] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.671103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.671103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.671255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.671412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.671664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.671781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.671843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.672050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.672181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.672324] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3df96746-b67b-4d06-9916-684e3d836127 is going to be deleted. [ 781.674558] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.729544] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.729544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.729544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.729544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.729544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.749400] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.749400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.749400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.749400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.749400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.750315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.751784] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 781.876237] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: SUCCESS [ 781.876458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.136100] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e646d6e-be8a-46da-bbb9-169ae7b46a46 req-9d15abd6-39ad-4928-ba0c-3ba8e6d77366 tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.136639] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.136946] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.137160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.137234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.137458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.137735] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.137735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.137833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.137903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.137987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.138154] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.167133] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3df96746-b67b-4d06-9916-684e3d836127: rpc.has_security_group_logging(os_id): False [ 782.168343] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a123fbf6-102f-4574-bd53-22fcf6ab3da8: rpc.has_security_group_logging(os_id): False [ 782.176814] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.187530] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.187746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.187816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.188288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.188288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.188446] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.188554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.188616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.188779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.188854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.188937] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be updated. [ 782.191455] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.191564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.191629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.191800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.191878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.192093] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.192189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.192248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.192565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.192565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.192565] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df96746-b67b-4d06-9916-684e3d836127 is going to be created. [ 782.212047] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127], does not exist path=[/infra/domains/default/groups/3df96746-b67b-4d06-9916-684e3d836127]."\n}' [ 782.212211] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df96746-b67b-4d06-9916-684e3d836127 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127 [ 782.212315] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 782.240999] env[65119]: INFO networking_nsxv3.common.synchronization [None req-39db8a89-faaf-406f-9612-96c23946e267 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 782.240999] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 782.241408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.241408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.241535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.243199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.243266] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.246083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.246083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.247302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.247302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.248171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.248482] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.248585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.248626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.248792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.248894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.249083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.249176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.249225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.249366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.249435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.249663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3df96746-b67b-4d06-9916-684e3d836127 is going to be created. [ 782.274642] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127], does not exist path=[/infra/domains/default/groups/3df96746-b67b-4d06-9916-684e3d836127]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127 [ 782.275053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3df96746-b67b-4d06-9916-684e3d836127" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.275310] env[65119]: Traceback (most recent call last): [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 782.275389] env[65119]: return func(*args, **kwargs) [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 782.275389] env[65119]: res.raise_for_status() [ 782.275389] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 782.275389] env[65119]: raise HTTPError(http_error_msg, response=self) [ 782.275389] env[65119]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127 [ 782.275389] env[65119]: During handling of the above exception, another exception occurred: [ 782.275389] env[65119]: Traceback (most recent call last): [ 782.275389] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 782.275389] env[65119]: listener.cb(fileno) [ 782.275389] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 782.275389] env[65119]: result = function(*args, **kwargs) [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 782.275389] env[65119]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 782.275389] env[65119]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 782.275389] env[65119]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 782.275389] env[65119]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 782.275389] env[65119]: res.raise_for_status() [ 782.275389] env[65119]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 782.275389] env[65119]: raise HTTPError(http_error_msg, response=self) [ 782.275389] env[65119]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3df96746-b67b-4d06-9916-684e3d836127 [ 782.275389] env[65119]: Removing descriptor: 5 [ 782.289160] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.289319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.289392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.289602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.289766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.302481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: IN_PROGRESS for 2s [ 782.389212] env[65119]: INFO networking_nsxv3.common.synchronization [None req-21188118-55ea-4e8e-887a-66c2765df86f tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 782.389821] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 782.390911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.391044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.484414] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e646d6e-be8a-46da-bbb9-169ae7b46a46 req-f72cac0c-d28c-4649-a668-8fe376b77b02 tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.484967] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.485292] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.485389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.640360] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.681804] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.681958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.682046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.682304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.682726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.682837] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 782.713373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.713522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.713598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.713805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.713954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.724921] env[65119]: INFO networking_nsxv3.common.synchronization [req-9e646d6e-be8a-46da-bbb9-169ae7b46a46 req-c06479cb-b425-4e34-940c-9d65ad957ccd tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.725864] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 782.726358] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 782.726701] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.726804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.783581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.783788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.783845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.784072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.784166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.784271] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 already deleted. [ 782.784354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.784846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.785029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.785124] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.146530] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.224150] env[65119]: INFO networking_nsxv3.common.synchronization [req-c9ff9bd4-e6ec-4be0-af7e-c79c80d2fd05 req-6d2277ab-ab3b-444d-9791-48acd42aae7e tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 783.224995] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 783.225408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.225842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.225950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.227998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.227998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.227998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.227998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.227998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.227998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.227998] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.317919] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.318278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.318392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.319999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.319999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.319999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 already deleted. [ 783.319999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.630930] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.631665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.631665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.631665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.631824] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.635031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.635031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.635031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.635031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.635031] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.635031] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.635031] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.635031] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.635031] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.635031] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.635031] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.649984] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.650299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.650398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.650609] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.650701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.650804] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 783.659094] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.659272] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.659365] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.659600] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.659852] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-4217d695-f473-499c-8158-21a1e7938aee taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.660040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.660141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.660478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.660611] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4217d695-f473-499c-8158-21a1e7938aee',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.685786] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.686193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.686312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.686591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.686767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.699263] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 783.732153] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.732153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.732153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.732153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.767132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.767132] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.767132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.767132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.767132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.767132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.767132] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 783.768900] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 783.768900] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 deletion is rescheduled due to dependency. [ 783.768900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.799476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.799606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.799606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.800498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.800498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.811169] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 784.009862] env[65119]: INFO networking_nsxv3.common.synchronization [None req-4d3f975b-07de-47db-8b1b-9766d27f6c9a None None] Enqueued Resource ID: da77ecc0-a871-4e4b-8b18-21932097fc24 with Priority: HIGHEST for action port [ 784.010498] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da77ecc0-a871-4e4b-8b18-21932097fc24 with Priority: HIGHEST for action port [ 784.010819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-da77ecc0-a871-4e4b-8b18-21932097fc24 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.010943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da77ecc0-a871-4e4b-8b18-21932097fc24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.011376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da77ecc0-a871-4e4b-8b18-21932097fc24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.011376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da77ecc0-a871-4e4b-8b18-21932097fc24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.011471] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da77ecc0-a871-4e4b-8b18-21932097fc24',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.163043] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.163525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.163525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.163694] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.163842] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.163993] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 4217d695-f473-499c-8158-21a1e7938aee not found, creating... [ 784.164266] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.164422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.164550] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.164761] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.164892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.165192] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.165344] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.165478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.165657] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.165789] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.165925] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 4217d695-f473-499c-8158-21a1e7938aee is going to be created. [ 784.187610] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.187829] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.188064] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.189173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.189173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.189173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.316432] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 in Status: SUCCESS [ 784.316750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.513681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da77ecc0-a871-4e4b-8b18-21932097fc24 [ 784.513819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.513894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.513975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.514203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.514294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.514390] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da77ecc0-a871-4e4b-8b18-21932097fc24 already deleted. [ 784.514475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da77ecc0-a871-4e4b-8b18-21932097fc24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.737540] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 784.738147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.738147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.738281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.738378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.738497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.738595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.739504] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.739938] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.739938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.739938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.740152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.740152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.740234] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.917046] env[65119]: INFO networking_nsxv3.common.synchronization [req-c9ff9bd4-e6ec-4be0-af7e-c79c80d2fd05 req-b42a3b48-60f8-406a-be90-2ee2f9b234dd service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 784.918200] env[65119]: INFO networking_nsxv3.common.synchronization [req-c9ff9bd4-e6ec-4be0-af7e-c79c80d2fd05 req-b42a3b48-60f8-406a-be90-2ee2f9b234dd service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 784.918200] env[65119]: INFO networking_nsxv3.common.synchronization [req-c9ff9bd4-e6ec-4be0-af7e-c79c80d2fd05 req-b42a3b48-60f8-406a-be90-2ee2f9b234dd service nova] Enqueued Resource ID: 4217d695-f473-499c-8158-21a1e7938aee with Priority: HIGHEST for action port [ 784.918200] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 784.918200] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 784.918200] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4217d695-f473-499c-8158-21a1e7938aee with Priority: HIGHEST for action port [ 784.918547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.918619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.918684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.918883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.918964] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.920543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.920759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.920968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4217d695-f473-499c-8158-21a1e7938aee taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.921092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.921160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.923921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.923921] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4217d695-f473-499c-8158-21a1e7938aee',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.242575] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f74596-fb6a-47cf-899d-a4910bf5e050: rpc.has_security_group_logging(os_id): False [ 785.261280] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.261669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.261805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.262065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.295845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.296384] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.296384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.296530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.296616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.296745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.296884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.296985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.297046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.297268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.297361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.297543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.297637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.297698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.297866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.297912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.297992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 785.363984] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.363984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.363984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.363984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.363984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.375828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 785.421765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.424631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.424897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4217d695-f473-499c-8158-21a1e7938aee with status ACTIVE [ 785.425118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.425257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.425334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.425573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.425659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.425851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.425963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.426056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.426234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.426315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.426521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.426618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.426693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.426838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.426911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.426999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4217d695-f473-499c-8158-21a1e7938aee is going to be updated. [ 785.460305] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.460305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.460305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.460305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.460305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.460763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4217d695-f473-499c-8158-21a1e7938aee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.710614] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 785.710840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.711234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.711472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.711663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.711780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.711877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.711986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.712084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.712183] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.821188] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 785.821425] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 785.821546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.821710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.821934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.822151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.822275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.822339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.822489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.822568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.822663] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.942560] env[65119]: INFO networking_nsxv3.common.synchronization [req-98c6ed8b-0c91-47bb-841b-35edf72ff075 req-f0f0357a-c5e9-484a-9328-f157bd4d0c37 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 785.943178] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 785.943491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.943629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.943776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.943981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.944187] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.944299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.944362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.944519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.944602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.944699] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.214315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.214496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.214548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.214762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.238039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238205] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.238315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.238387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.238593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.238679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 786.268051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.268461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.268461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.268589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.268688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.279715] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 786.303063] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-358 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303368] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.303665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.303934] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.306910] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.311092] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.311092] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.311092] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.311092] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.311092] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.311092] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.311092] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.311092] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.311092] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.311092] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.325340] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.333305] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.333470] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.333606] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.333788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.334115] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.334445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.334445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.335468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.335468] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c59cd6c6-2db3-42bf-a69e-2b09c24b0d13',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.447660] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.447660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.447660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.447955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.469123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.469436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.469577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.469642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.469855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.469940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.470044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 786.496397] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.496748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.496830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.497060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.497356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.508576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 786.827362] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.838292] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.838292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.838487] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.838745] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.838905] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.839128] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 not found, creating... [ 786.839419] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.840031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.840031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.840031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.840347] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.840533] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.840727] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.840880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.841176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.841374] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.841555] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 is going to be created. [ 786.879052] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.879454] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.879571] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.879847] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.880086] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.880319] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.333536] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.333834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.333834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.333974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.334077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.334181] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 787.366680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.366864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.366918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.367142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.367531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380791] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 787.392210] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 787.393117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.613577] env[65119]: INFO networking_nsxv3.common.synchronization [req-98c6ed8b-0c91-47bb-841b-35edf72ff075 req-4e88bb00-459f-4521-9059-758e297cbb1f service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 787.613771] env[65119]: INFO networking_nsxv3.common.synchronization [req-98c6ed8b-0c91-47bb-841b-35edf72ff075 req-4e88bb00-459f-4521-9059-758e297cbb1f service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 787.614890] env[65119]: INFO networking_nsxv3.common.synchronization [req-98c6ed8b-0c91-47bb-841b-35edf72ff075 req-4e88bb00-459f-4521-9059-758e297cbb1f service nova] Enqueued Resource ID: c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 with Priority: HIGHEST for action port [ 787.614890] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 787.614890] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 787.614890] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 with Priority: HIGHEST for action port [ 787.615119] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.615181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.615219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.615427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.615518] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.616493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.616594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.616849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.617017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.617115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.617325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.618230] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c59cd6c6-2db3-42bf-a69e-2b09c24b0d13',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.996632] env[65119]: INFO networking_nsxv3.common.synchronization [req-2892a6d9-0ecf-40b6-b9f0-e364b5a4797d req-7730c830-491e-4b2d-9a37-b0597d8ea8e5 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 787.996632] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 787.996813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.996943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.996986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.997829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.998045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.998208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.998308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.998462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.998585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.998698] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.123022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.123022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 with status ACTIVE [ 788.123022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.123022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.123022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.123022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.123764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.123764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.123764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.123764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.123764] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c59cd6c6-2db3-42bf-a69e-2b09c24b0d13 is going to be updated. [ 788.148539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.148539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.148778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.148778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.148930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.149283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c59cd6c6-2db3-42bf-a69e-2b09c24b0d13" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.294551] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 788.294551] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 deletion is rescheduled due to dependency. [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.294551] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.294551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.294551] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.504024] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.521922] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 788.522120] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 788.522285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.522401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.522615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.522797] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.522914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.522984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.523243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.523323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.523422] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.756545] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5b4a624-93b3-4965-87dd-a1fff478b956 req-29bf5be4-bd6d-47aa-b7ee-5d088d00cbf8 tempest-ServersV294TestFqdnHostnames-1932911180 tempest-ServersV294TestFqdnHostnames-1932911180-project-member] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 788.757104] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 788.758024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.758024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.758024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.758024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.758450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.758621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.758770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.758959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.759086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.759953] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.800180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.800356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.800442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.800682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.800775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.800996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.801122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.801207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.801373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.801452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.801542] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 788.832241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.832418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.832486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.832718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.832870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.843456] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 789.005445] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.026990] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.127919] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.128103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-306" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.128319] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-306" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.128639] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-306" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.128911] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.132074] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.132233] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.132516] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.132698] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.132918] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.133039] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.133148] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.133255] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.133445] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.133581] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.133714] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.158665] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.158917] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.159106] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.159434] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-306" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.159778] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-c8d12e83-3df5-4952-ac7c-27d6220ddb32 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.159992] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.160165] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.160579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.160757] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d12e83-3df5-4952-ac7c-27d6220ddb32',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.265380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.265380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.265380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.265380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.265380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.265640] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.265742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.265832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.266060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.266169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.266292] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 already deleted. [ 789.266402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.396213] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 789.396501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.398493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.398493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.398493] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.489539] env[65119]: INFO networking_nsxv3.common.synchronization [req-ec14e052-458c-456c-9141-f2f16fc24669 req-01aff716-50f4-455d-b6aa-9d5a77c271b6 tempest-ListServersNegativeTestJSON-1580752420 tempest-ListServersNegativeTestJSON-1580752420-project-member] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 789.490188] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGHEST for action security_group_members [ 789.490533] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.490668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.507361] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.507786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.507786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.507786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.507973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.507973] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 789.529173] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.542720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.542919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.542998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.543222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.543375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.554155] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 789.663272] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.663515] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.663647] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.663922] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.664082] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.664240] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port c8d12e83-3df5-4952-ac7c-27d6220ddb32 not found, creating... [ 789.664518] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.664710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.664841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.665112] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.665253] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.665580] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.665762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.666449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.666817] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.666912] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.667550] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: c8d12e83-3df5-4952-ac7c-27d6220ddb32 is going to be created. [ 789.696763] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.697144] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.697144] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.697392] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.697623] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.697852] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.900999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.901225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.901340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.901616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.901811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.901925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.902018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.902210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.902304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.902400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.902578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.902679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.902743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.902917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.903109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.903208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.903280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.903470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.903569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.903658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.903755] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.033998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.034219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.034353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.034546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.034677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.034732] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 790.065920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.066160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.066160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.066368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.066520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.075363] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 790.389732] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5b4a624-93b3-4965-87dd-a1fff478b956 req-acf051c0-6438-4b2b-9767-d427fd4d5019 service nova] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 790.389998] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5b4a624-93b3-4965-87dd-a1fff478b956 req-acf051c0-6438-4b2b-9767-d427fd4d5019 service nova] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 790.390434] env[65119]: INFO networking_nsxv3.common.synchronization [req-a5b4a624-93b3-4965-87dd-a1fff478b956 req-acf051c0-6438-4b2b-9767-d427fd4d5019 service nova] Enqueued Resource ID: c8d12e83-3df5-4952-ac7c-27d6220ddb32 with Priority: HIGHEST for action port [ 790.390994] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_rules [ 790.391412] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 790.391559] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d12e83-3df5-4952-ac7c-27d6220ddb32 with Priority: HIGHEST for action port [ 790.391880] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.392077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.392139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.392399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.392500] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.395653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.395947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.398238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.398486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.398667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.398776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.398840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.399008] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.399118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.399271] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.400827] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8d12e83-3df5-4952-ac7c-27d6220ddb32 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.400827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.400827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.401215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.401215] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d12e83-3df5-4952-ac7c-27d6220ddb32',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.406735] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 790.424453] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.424610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.424703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.424975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.425117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.425312] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.425426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.425495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.425655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.425746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.425939] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.426058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.426137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.426294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.426380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.426581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.426689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.426742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.426885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.426962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.427196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 790.493385] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.493573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.493651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.493868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.494055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.508588] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 790.856552] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 790.856552] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 deletion is rescheduled due to dependency. [ 790.856552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.904105] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.904105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.904390] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8d12e83-3df5-4952-ac7c-27d6220ddb32 with status ACTIVE [ 790.904615] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.904741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.904807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.905020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.905121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.905522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.905615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.905773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.905917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.906041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.906407] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.906578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.906702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.906937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.907061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.907186] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8d12e83-3df5-4952-ac7c-27d6220ddb32 is going to be updated. [ 790.908854] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.930979] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.931182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.931274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.931483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.931621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.931786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8d12e83-3df5-4952-ac7c-27d6220ddb32" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.412322] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.564566] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 791.564879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.564946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.565173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.565359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.565475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.565538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.565750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.565750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.565850] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.915238] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.915408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.915482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.915703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.915864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.915919] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 is going to be created. [ 791.941052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.941249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.941308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.941495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.941870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.952522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: UNINITIALIZED for 2s [ 792.069282] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.069541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.069628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.069909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088898] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088898] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.094194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.094194] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.094194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.094194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.094455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.094455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.094525] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be updated. [ 792.128630] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.128920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.128920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.129148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.129286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.140104] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: IN_PROGRESS for 2s [ 792.526748] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 792.527035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.592354] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.592683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.592683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.592683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.592857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.592958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.593033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.593198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.593289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.593378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.593525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.593615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.593671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.593805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.593947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.594050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.594112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.594251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.594327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.594408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.594504] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.100507] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a32e7cc-5871-4cac-93b4-13eb1e04d001: rpc.has_security_group_logging(os_id): False [ 793.119851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.119993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.120076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.120295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.120381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.120933] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.120933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.120933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.120933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.121158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.121158] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.124021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.124021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 793.192663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.192824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.192872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.205474] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 793.438986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.439263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.439338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.439584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.439786] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.730556] env[65119]: INFO networking_nsxv3.common.synchronization [req-83851142-5fd8-4673-b25a-db00132c245a req-9fb689b8-a998-4984-992c-16cf2cf1d578 tempest-FloatingIPsAssociationTestJSON-1574037461 tempest-FloatingIPsAssociationTestJSON-1574037461-project-member] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 793.733522] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 793.733522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.733522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.733522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.733522] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.927411] env[65119]: INFO networking_nsxv3.common.synchronization [None req-205d0507-689f-42e7-9eac-19a1b7c1e7d7 None None] Enqueued Resource ID: f2fd559b-670b-4467-8732-1b778eb6f352 with Priority: HIGHEST for action port [ 793.928184] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fd559b-670b-4467-8732-1b778eb6f352 with Priority: HIGHEST for action port [ 793.929765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2fd559b-670b-4467-8732-1b778eb6f352 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.929765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2fd559b-670b-4467-8732-1b778eb6f352" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.929765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2fd559b-670b-4467-8732-1b778eb6f352" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.930118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2fd559b-670b-4467-8732-1b778eb6f352" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.930118] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2fd559b-670b-4467-8732-1b778eb6f352',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.942305] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.962678] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: SUCCESS [ 793.963185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.963185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.963367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.963633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.963633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.963793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.963840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.963924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.964017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.964203] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.149740] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc in Status: SUCCESS [ 794.150069] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc deletion is rescheduled due to dependency. [ 794.150069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.237457] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.238495] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.238872] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.239196] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.239279] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.239881] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.239881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.239881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.240164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.240164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.240553] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.240553] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.240553] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.241086] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.241086] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.241086] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.241086] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.260635] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.260808] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.262232] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.262232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-971" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.262232] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.262232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.262232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.262232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.262232] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.432389] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2fd559b-670b-4467-8732-1b778eb6f352 [ 794.432627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.432762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.432829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.433065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.433175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.433278] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2fd559b-670b-4467-8732-1b778eb6f352 already deleted. [ 794.433410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2fd559b-670b-4467-8732-1b778eb6f352" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.447517] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.452920] env[65119]: INFO networking_nsxv3.common.synchronization [req-67741513-c495-40f7-a4c9-bee75586136e req-ce08c981-c6f6-49ba-858e-4e10c06b857d tempest-FloatingIPsAssociationNegativeTestJSON-2122394855 tempest-FloatingIPsAssociationNegativeTestJSON-2122394855-project-member] Enqueued Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 794.452920] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGHEST for action security_group_members [ 794.452920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.452920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.452920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.452920] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.466359] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.742908] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.764313] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.765214] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.765214] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.765214] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.765214] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.765456] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e not found, creating... [ 794.767949] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.767949] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.767949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.769213] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.769450] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e is going to be created. [ 794.792589] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.792823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.792954] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.793442] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.793534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.793754] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.953234] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 794.953234] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 794.954876] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.955043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.955122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.955322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.968019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1934d43b-3b83-45a9-9b48-612e7248acc7: rpc.has_security_group_logging(os_id): False [ 794.985162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.985162] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.985162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.985162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.985162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.985162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.985162] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 is going to be updated. [ 794.986583] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.986709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.986778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.986974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.987071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.987312] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.987416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.987478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.987630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.987704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.987815] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 is going to be created. [ 795.018059] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.018270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.018350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.018555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.018692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.028819] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: IN_PROGRESS for 2s [ 795.053118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.053118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.053118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.053363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.053399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.066890] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: IN_PROGRESS for 2s [ 795.218253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 795.218766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.245888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.245888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.245888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.246120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.246120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.246120] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be updated. [ 795.279014] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.280182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.280529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.280921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.282424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.293522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 795.541621] env[65119]: INFO networking_nsxv3.common.synchronization [req-83851142-5fd8-4673-b25a-db00132c245a req-25cc08e0-7226-4271-93f5-4e453a904064 service nova] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_rules [ 795.541621] env[65119]: INFO networking_nsxv3.common.synchronization [req-83851142-5fd8-4673-b25a-db00132c245a req-25cc08e0-7226-4271-93f5-4e453a904064 service nova] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 795.542054] env[65119]: INFO networking_nsxv3.common.synchronization [req-83851142-5fd8-4673-b25a-db00132c245a req-25cc08e0-7226-4271-93f5-4e453a904064 service nova] Enqueued Resource ID: 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e with Priority: HIGHEST for action port [ 795.542054] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_rules [ 795.542198] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 795.542322] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e with Priority: HIGHEST for action port [ 795.542772] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.543363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.543487] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.544470] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.544585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.544853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.546050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.546050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.546307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.546424] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.891515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.891869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.891869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.892198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.915583] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 796.067701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.069272] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 796.070973] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.071131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.071269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e with status ACTIVE [ 796.071448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.071594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.071661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.071856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.071934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.072117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.072223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.072280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.072455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.072559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.072800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.072915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.072977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.073127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.073195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.074033] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e is going to be updated. [ 796.077125] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b11158ee-eaf8-4a03-8b96-7d5426b5035b tempest-ServersTestManualDisk-260502750 tempest-ServersTestManualDisk-260502750-project-member] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 796.078160] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 796.078322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.078440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.078508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.078807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.078925] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.099458] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.099458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.099458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.099458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.099458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.099661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dfa44e6-5cc3-4410-91ab-aa4e0f93df4e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.107938] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.108140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.108194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.108408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.113959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.114472] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 796.114555] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.114640] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 796.158388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.158388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.158501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.158848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.159792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.159967] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 796.178295] env[65119]: INFO networking_nsxv3.common.synchronization [None req-d0b6d261-95a6-43f5-8bb1-32afecbab390 tempest-ServersTestManualDisk-260502750 tempest-ServersTestManualDisk-260502750-project-member] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 796.178866] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 796.179219] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.179452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.236927] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.237086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.237154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.237400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.237622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.237833] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 796.400591] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.401722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.402370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.403428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.403811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.404432] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 796.404611] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1934d43b-3b83-45a9-9b48-612e7248acc7', '4720d561-4590-44ad-bcfd-bb12e7297342', '9dd81141-ab63-45d1-8370-e285d4f0dfa9', '31ff7630-123f-4898-982a-bb6d45f72689', '8715bb3f-fafd-4a93-8c90-1ffdefe06065', 'a1d77171-74cb-4523-ba62-d51303f9c0b4', '1716238a-d758-431d-b1b3-35d3e7b9b9bc', '373d855b-b953-484c-8b48-75904bb81afd', '8e98c9fd-6d96-4213-8b32-1af5b432b21f', '81cbcc67-f57a-4093-8432-a803e36e5a2f', 'bcf37b8c-257f-4c76-a225-26bb55a61d9a', 'a123fbf6-102f-4574-bd53-22fcf6ab3da8', 'c93a8142-3940-4c00-a52e-9490a9ce5342', 'f1faaf9f-2e81-4209-bb0c-5887f3619279', '154abdb7-4268-41a3-bf4b-26f5e9656c76', '9c8d847d-37b1-463b-97ac-e2ed6f3f78c9', '40f16dbf-b372-4ba6-94a5-e3bf17f87f96', '9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec', '7aab303d-69ac-46ee-a55d-5ef201d83e38', 'c59b58cb-0641-49be-856b-56dc606d886a', '78855541-03b8-4d32-871e-c374cb44f414', '09eeb8ed-53fe-4534-ba39-d93429300967', '511a8f2f-3767-4d34-9d44-c9a6cd510c1a', '1a40b8a7-01bb-4eb9-8b40-fe7596c9d197', 'ed152bbd-2522-4d15-9d17-a181bc283606', '7a32e7cc-5871-4cac-93b4-13eb1e04d001', 'cec5d72a-5222-4ea2-bb61-5a248eace68e', '07660c72-b919-4d62-b37d-9ae294d80c7d', 'd044d815-6af5-4fd9-a0b1-bc64182a7697', 'a4688087-743d-4d09-ac40-3272e1f90bc5', '75aafba1-23a9-48ba-a855-7337f0a9b868', '21f74596-fb6a-47cf-899d-a4910bf5e050', 'b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a', 'a7c347da-631c-445c-b2e6-004a6894e069'} {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.404919] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 796.430910] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.430910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.430910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.430910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.431109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.431367] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 796.431367] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.431570] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 796.493313] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.493556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.493798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.494069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.494752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.495253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 796.495253] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.496133] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 796.496325] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 796.496416] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 796.496759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGH for action security_group_rules [ 796.496759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGH for action security_group_rules [ 796.496759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGH for action security_group_rules [ 796.496759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGH for action security_group_rules [ 796.496759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGH for action security_group_rules [ 796.496944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGH for action security_group_rules [ 796.496944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGH for action security_group_rules [ 796.496944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGH for action security_group_rules [ 796.497056] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGH for action security_group_rules [ 796.497056] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGH for action security_group_rules [ 796.497121] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGH for action security_group_rules [ 796.497152] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGH for action security_group_rules [ 796.497198] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGH for action security_group_rules [ 796.497257] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGH for action security_group_rules [ 796.497345] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 796.497417] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGH for action security_group_rules [ 796.497480] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGH for action security_group_rules [ 796.497542] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGH for action security_group_rules [ 796.497601] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGH for action security_group_rules [ 796.497663] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGH for action security_group_rules [ 796.497765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.554067] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7a6de3c1-3a85-4d73-947a-476875f4bd14 None None] Enqueued Resource ID: 61d0ac60-ec14-43af-97c5-f5e30a71630d with Priority: HIGHEST for action port [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d0ac60-ec14-43af-97c5-f5e30a71630d with Priority: HIGHEST for action port [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGH for action security_group_rules [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 with Priority: HIGH for action security_group_rules [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc with Priority: HIGH for action security_group_rules [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 796.555291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59b58cb-0641-49be-856b-56dc606d886a with Priority: HIGH for action security_group_rules [ 796.555528] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 with Priority: HIGH for action security_group_rules [ 796.555562] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93a8142-3940-4c00-a52e-9490a9ce5342 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 with Priority: HIGH for action security_group_rules [ 796.556464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373d855b-b953-484c-8b48-75904bb81afd with Priority: HIGH for action security_group_rules [ 796.556827] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 with Priority: HIGH for action security_group_rules [ 796.556827] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4720d561-4590-44ad-bcfd-bb12e7297342 with Priority: HIGH for action security_group_rules [ 796.556827] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGH for action security_group_rules [ 796.557053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-61d0ac60-ec14-43af-97c5-f5e30a71630d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.557143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61d0ac60-ec14-43af-97c5-f5e30a71630d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.557185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61d0ac60-ec14-43af-97c5-f5e30a71630d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.557408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61d0ac60-ec14-43af-97c5-f5e30a71630d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.557489] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61d0ac60-ec14-43af-97c5-f5e30a71630d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.558795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.558795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.559067] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.559138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.559189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.559339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.559428] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd81141-ab63-45d1-8370-e285d4f0dfa9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.560164] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.560271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.560338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.560541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.560619] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1716238a-d758-431d-b1b3-35d3e7b9b9bc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.561313] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.561406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.561619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.561687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.561770] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.563108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59b58cb-0641-49be-856b-56dc606d886a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.563254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.563328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.563483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.563556] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59b58cb-0641-49be-856b-56dc606d886a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.564768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aab303d-69ac-46ee-a55d-5ef201d83e38 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.564853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.565060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.565137] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aab303d-69ac-46ee-a55d-5ef201d83e38',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.566054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.566157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.566227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.566369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.566441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.567370] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.567370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.567537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.567586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.567631] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.568581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.568680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.568745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.568962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.569044] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.569871] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.569976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.570093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.570304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.570379] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c8d847d-37b1-463b-97ac-e2ed6f3f78c9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.570606] env[65119]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 796.571265] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93a8142-3940-4c00-a52e-9490a9ce5342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.571373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.571529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.571678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.571810] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93a8142-3940-4c00-a52e-9490a9ce5342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.573190] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.573335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.573418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.573716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.573790] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a123fbf6-102f-4574-bd53-22fcf6ab3da8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.574732] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.574789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.574852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.575086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.575159] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf37b8c-257f-4c76-a225-26bb55a61d9a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.575988] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81cbcc67-f57a-4093-8432-a803e36e5a2f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.576111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.576177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.576324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.576396] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81cbcc67-f57a-4093-8432-a803e36e5a2f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.577363] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.577462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.577526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.577678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.577755] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e98c9fd-6d96-4213-8b32-1af5b432b21f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.578638] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d77171-74cb-4523-ba62-d51303f9c0b4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.578996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.579110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.579289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.579364] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d77171-74cb-4523-ba62-d51303f9c0b4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.580911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373d855b-b953-484c-8b48-75904bb81afd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.580911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.580911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.580911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.580911] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373d855b-b953-484c-8b48-75904bb81afd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.581460] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.581559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.581725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.581973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.582057] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8715bb3f-fafd-4a93-8c90-1ffdefe06065',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.584183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4720d561-4590-44ad-bcfd-bb12e7297342 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.584183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.584183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.584183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.584183] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4720d561-4590-44ad-bcfd-bb12e7297342',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.584584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.584684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.584747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.584890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.584965] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.585187] env[65119]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 796.615814] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.616015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.616156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.616431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.616532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.616643] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 already deleted. [ 796.616732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.617666] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.617794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.617865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.618056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.623069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.623272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.623359] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.655231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.655465] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd81141-ab63-45d1-8370-e285d4f0dfa9 is going to be deleted. [ 796.736488] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.736680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.736796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.736995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.737083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.737216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd81141-ab63-45d1-8370-e285d4f0dfa9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.039770] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93a8142-3940-4c00-a52e-9490a9ce5342 in Status: SUCCESS [ 797.039770] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 deletion is rescheduled due to dependency. [ 797.039770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.080451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: SUCCESS [ 797.080451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.080451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.080869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.080869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.091738] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61d0ac60-ec14-43af-97c5-f5e30a71630d [ 797.091738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.091738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.092075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.092075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.092153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.092843] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61d0ac60-ec14-43af-97c5-f5e30a71630d already deleted. [ 797.092843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61d0ac60-ec14-43af-97c5-f5e30a71630d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.109482] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.109627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.109713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.109918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.111852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.111980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.130561] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.130783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.130783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.131055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.131296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.131410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.131472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.131651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.131741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.131843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.131938] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.133676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.133795] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1716238a-d758-431d-b1b3-35d3e7b9b9bc is going to be deleted. [ 797.136492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.136492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.136678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.136714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.136961] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.136961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.137104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.137198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.137354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.137354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.137482] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.139049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.139049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.148746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.148883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.148963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.149181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.149356] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.149673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.149673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.149673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.149798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.149830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.150056] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.157219] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.157336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.194037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.194037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.196201] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.196366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.202904] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.203108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.204259] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.205049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.206815] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.207088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.207937] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.208061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.210124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.210540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.211405] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.213027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.213027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.213027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.214680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.214680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.214680] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.215218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.215218] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be deleted. [ 797.216642] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.216782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.216879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.217725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.219226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.219226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.220022] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.221050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.221050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.236295] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.237034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.237228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.244130] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.244672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.244921] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aab303d-69ac-46ee-a55d-5ef201d83e38 is going to be deleted. [ 797.245857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.246098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.267392] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.267756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.269509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.269650] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93a8142-3940-4c00-a52e-9490a9ce5342 is going to be deleted. [ 797.271124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.272143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.307512] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 797.307779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.307962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.308324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.308449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.308573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.308631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.308789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.308869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.308965] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.310873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.311226] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a123fbf6-102f-4574-bd53-22fcf6ab3da8 is going to be deleted. [ 797.312165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.312240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.333802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.333963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.350550] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.350779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.353947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.354115] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c8d847d-37b1-463b-97ac-e2ed6f3f78c9 is going to be deleted. [ 797.355528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.355528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.425253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.425253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59b58cb-0641-49be-856b-56dc606d886a is going to be deleted. [ 797.426579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.426579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.429688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.431346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.433117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.433117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.472929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.472929] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf37b8c-257f-4c76-a225-26bb55a61d9a is going to be deleted. [ 797.473781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.474132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.525502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.525771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d77171-74cb-4523-ba62-d51303f9c0b4 is going to be deleted. [ 797.526899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.526899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.538579] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.538890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.582362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.582591] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373d855b-b953-484c-8b48-75904bb81afd is going to be deleted. [ 797.584071] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.584279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.584347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.585068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.585319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.585428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.585485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.585666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.585804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.585921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.586067] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.587612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.588037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.642253] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.642341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.642519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.642722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.642965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.643128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.643250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.643440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.643617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.643767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.644061] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.644201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.644316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.644570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.644811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.644983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.645410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.645410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.645563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.645616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.645768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.647675] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.658942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.659180] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4720d561-4590-44ad-bcfd-bb12e7297342 is going to be deleted. [ 797.660306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.660708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.664576] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.716310] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.716690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.721586] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.721774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.723219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.723521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8715bb3f-fafd-4a93-8c90-1ffdefe06065 is going to be deleted. [ 797.724814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.725073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.729407] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.729759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.787950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.788302] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec is going to be deleted. [ 797.789681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.789681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.812314] env[65119]: INFO networking_nsxv3.common.synchronization [req-38e8c5ae-92fd-44ee-96d2-f25dfb05718f req-afaba442-d5ac-40ee-a4c1-c0beab8ba042 tempest-ListImageFiltersTestJSON-1838690385 tempest-ListImageFiltersTestJSON-1838690385-project-member] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 797.813578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.813578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.813889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.813976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.814424] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 797.814655] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.815505] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.815612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.816317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.816317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.816317] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.816317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.816317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.816721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.816721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.816721] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.825872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.826950] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81cbcc67-f57a-4093-8432-a803e36e5a2f is going to be deleted. [ 797.827899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.828148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.828263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.828376] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 already deleted. [ 797.828488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.830466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.830466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.870023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.870023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e98c9fd-6d96-4213-8b32-1af5b432b21f is going to be deleted. [ 797.871029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.871029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.871029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.871029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1716238a-d758-431d-b1b3-35d3e7b9b9bc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.871212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.871244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.871336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.871449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aab303d-69ac-46ee-a55d-5ef201d83e38" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.872859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93a8142-3940-4c00-a52e-9490a9ce5342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.873101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.873101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.873101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.873271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a123fbf6-102f-4574-bd53-22fcf6ab3da8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.873399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.873453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.873517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c8d847d-37b1-463b-97ac-e2ed6f3f78c9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59b58cb-0641-49be-856b-56dc606d886a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf37b8c-257f-4c76-a225-26bb55a61d9a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373d855b-b953-484c-8b48-75904bb81afd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.875785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.876527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.876636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.877029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d77171-74cb-4523-ba62-d51303f9c0b4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.877496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.877773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.878679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.879961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8715bb3f-fafd-4a93-8c90-1ffdefe06065" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.879961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.879961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.879961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.879961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4720d561-4590-44ad-bcfd-bb12e7297342" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.935222] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.935222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.935222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.935222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.935222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.935222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fc8b8a8-0fb3-429f-b206-62a0cf5e41ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.967328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.967480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.968544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.968544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.968544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.968544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81cbcc67-f57a-4093-8432-a803e36e5a2f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.055219] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 798.055940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.056058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.056103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.056374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.057150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.057150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e98c9fd-6d96-4213-8b32-1af5b432b21f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.088881] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.150071] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31ff7630-123f-4898-982a-bb6d45f72689: rpc.has_security_group_logging(os_id): False [ 798.151187] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f16dbf-b372-4ba6-94a5-e3bf17f87f96: rpc.has_security_group_logging(os_id): False [ 798.166854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1faaf9f-2e81-4209-bb0c-5887f3619279: rpc.has_security_group_logging(os_id): False [ 798.182834] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.184414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.184414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.184414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.184414] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.184414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.184785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.184785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.184991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.185244] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.185244] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.185335] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.185426] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.186059] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.186059] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.186059] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.188306] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.188467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.188725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.188725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.190404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.190509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.210492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.210630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.225073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.225477] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.225634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.225701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.225909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.225989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.226228] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.226327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.226390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.226634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.226746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.227103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.227226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.227301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.227466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.227552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.227653] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 798.229381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.229566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.233522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.233522] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.233522] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.233522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.233522] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b2dd6334-fdbb-49f3-ba3e-810158b25676 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.233522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.233522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.233522] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.233522] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dd6334-fdbb-49f3-ba3e-810158b25676',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.254775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.255291] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.255291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.255291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.255478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.255516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.255895] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 798.256942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.279136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.279499] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.279659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.280849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.280849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.280849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.280849] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 is going to be updated. [ 798.318467] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.319447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.319591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.319634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.319816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.319904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.320124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.320239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.320303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.320454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.320554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.320628] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a already deleted. [ 798.320704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.357749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.357749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.357873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.358323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.358323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.365296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.365437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.365512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.365723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.365861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.379704] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 798.381202] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 798.403996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.404488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.404583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.404998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.405242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.437202] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: IN_PROGRESS for 2s [ 798.592561] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1934d43b-3b83-45a9-9b48-612e7248acc7: rpc.has_security_group_logging(os_id): False [ 798.616153] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.616288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.616288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.616796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.636542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.636850] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.636980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.637065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.637262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.637343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.637434] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 is going to be updated. [ 798.698487] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.698632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.698741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.698914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.699082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.712909] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: IN_PROGRESS for 2s [ 798.735138] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.735334] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.735469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.735732] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.735870] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.736035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b2dd6334-fdbb-49f3-ba3e-810158b25676 not found, creating... [ 798.736376] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.736538] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.736669] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.736890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.737055] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.737825] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.739051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.739051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.739051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.739051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.739051] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b2dd6334-fdbb-49f3-ba3e-810158b25676 is going to be created. [ 798.775634] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.775911] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.775998] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.776342] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.776697] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.777157] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.822548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.823281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.823281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.823281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.823588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.823588] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be updated. [ 798.897044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.897265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.897265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.897465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.897612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.908340] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 799.478652] env[65119]: INFO networking_nsxv3.common.synchronization [req-38e8c5ae-92fd-44ee-96d2-f25dfb05718f req-3ca06692-d811-4a3e-9579-89f2a3b413ae service nova] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_rules [ 799.478652] env[65119]: INFO networking_nsxv3.common.synchronization [req-38e8c5ae-92fd-44ee-96d2-f25dfb05718f req-3ca06692-d811-4a3e-9579-89f2a3b413ae service nova] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 799.478652] env[65119]: INFO networking_nsxv3.common.synchronization [req-38e8c5ae-92fd-44ee-96d2-f25dfb05718f req-3ca06692-d811-4a3e-9579-89f2a3b413ae service nova] Enqueued Resource ID: b2dd6334-fdbb-49f3-ba3e-810158b25676 with Priority: HIGHEST for action port [ 799.479228] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_rules [ 799.479228] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 799.479313] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2dd6334-fdbb-49f3-ba3e-810158b25676 with Priority: HIGHEST for action port [ 799.479741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.479741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.479906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.480378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.480501] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.481770] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.481918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.481960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.482149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.482321] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.482433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.482492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.482637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.482723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.482811] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.483612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2dd6334-fdbb-49f3-ba3e-810158b25676 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.483740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.483800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.484644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.484644] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dd6334-fdbb-49f3-ba3e-810158b25676',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.986148] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.987463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.987585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.987765] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2dd6334-fdbb-49f3-ba3e-810158b25676 with status ACTIVE [ 799.987964] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.988090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.988155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.988408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.988505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.988675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.988783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.988931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.992636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992636] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2dd6334-fdbb-49f3-ba3e-810158b25676 is going to be updated. [ 800.018019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.018019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.018019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.018019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.018019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.018326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2dd6334-fdbb-49f3-ba3e-810158b25676" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.399309] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 800.399625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.400629] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 800.400868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.455732] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: SUCCESS [ 800.456870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.494562] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.726896] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: SUCCESS [ 800.727221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.919098] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 800.919369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.919562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.919850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.919990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.920122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.920191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.920349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.920432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.920516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.920612] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.997952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.998153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.998216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.998472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.998564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.998682] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be created. [ 801.025527] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.025527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.025527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.025527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.025527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.035127] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: UNINITIALIZED for 2s [ 801.423804] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.424066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.424066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.424283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.424464] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.424566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.424626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.424780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.424868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.424954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.425116] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.425209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.425269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.425405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.425554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.425674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.425737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.425876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.425952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.426041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.426132] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.928756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197: rpc.has_security_group_logging(os_id): False [ 801.950980] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.950980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.950980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.951554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.974401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.975793] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.975793] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.975793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.976247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.976247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.976247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.976353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.976384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.976468] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be updated. [ 802.054816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.055339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.055339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.055494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.055701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.069136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 803.046631] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 803.047039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.047039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.047218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.047416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.047537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.047647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.047875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.047961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.048097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.048175] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.551028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.551182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.551247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.551476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.551675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.551801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.551880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.552084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.552185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.552284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.552547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.552547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.552673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.552780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.552935] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.553051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.553132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.553292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.553379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.553483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.553595] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.055756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a096698e-b6ff-45f7-a422-2ae93392dd6a: rpc.has_security_group_logging(os_id): False [ 804.078602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.078602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.078824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.078862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.078948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.079167] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.079276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.079347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.079476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.079573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.079743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.080012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.080221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.080294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.080489] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.080602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.080834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.080903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.080989] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be created. [ 804.084052] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 804.084052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.152757] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.152867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.152916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.153289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.153407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.166941] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 804.480534] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 804.480983] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 806.183071] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 806.183071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.482802] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 809.483240] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 810.924142] env[65119]: INFO networking_nsxv3.common.synchronization [req-8c4ef639-63ff-4beb-af93-3d1c108cfd5a req-e0456382-4c16-4f08-ab66-2012aeb0b908 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 810.924918] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 810.925710] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.925905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.926022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.926275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.926512] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.926653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.926769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.926987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.927145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.927293] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.430679] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.430912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.431038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.431299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.458512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.458512] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.458512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.458512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.458836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.458836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.458836] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 811.508762] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.508762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.508762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.508762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.508762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.518519] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 811.732833] env[65119]: INFO networking_nsxv3.common.synchronization [req-c99ed7be-de32-42b9-a048-c04dbedeabdf req-01cc09af-c899-494b-931b-edb21d59a7f6 tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 811.733569] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 811.734351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.734351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.734526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.734648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.734816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.734923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.735037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.735257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.735349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.735452] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.242416] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.745260] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.819110] env[65119]: INFO networking_nsxv3.common.synchronization [req-ae85dca9-875a-45fe-bb99-d9875d81c747 req-1c8cb6e3-8071-4ec5-8bd9-23cd94eee266 tempest-FloatingIPsAssociationTestJSON-1574037461 tempest-FloatingIPsAssociationTestJSON-1574037461-project-member] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 812.819682] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 812.819997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.820271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.820355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.820544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.820737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.820804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.820841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.820993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.821092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.821180] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.249995] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.250344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.250344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.250748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.250748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.250748] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 813.287019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.287019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.287019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.287019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.287019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.296106] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 813.327081] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.528683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 813.528880] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 813.528960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.801268] env[65119]: INFO networking_nsxv3.common.synchronization [req-5c4ad4f4-40b8-4624-9086-97e4b3c0179f req-68c56e9d-8b2f-4d64-85a7-32ed0fd8824a tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 813.801268] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 813.801909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.801909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.801909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.802115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.802170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.802272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.802369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.802505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.802590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.802696] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.831220] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.197220] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.197433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.197877] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.197877] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.200385] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.200636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.200796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.201369] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.201712] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.201832] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.202256] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.202256] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.202371] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.202485] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.202620] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.202779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.223030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.223030] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.223030] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.223221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-196" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.223387] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-a6cab26a-04ed-4424-a612-b8bb8525e252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.224126] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.224126] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.224126] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.224126] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6cab26a-04ed-4424-a612-b8bb8525e252',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.305399] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.333954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.334185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.334185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.334397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.334501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.334627] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be updated. [ 814.368787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.368962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.369057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.369492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.369656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.379554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 814.729427] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.729427] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port a6cab26a-04ed-4424-a612-b8bb8525e252 not found, creating... [ 814.729427] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.729427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.729988] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.730403] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.730765] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.731305] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.733139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.733139] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: a6cab26a-04ed-4424-a612-b8bb8525e252 is going to be created. [ 814.753881] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.753881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.753881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.753881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.753881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.753881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.808058] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.306773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 815.307213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.310546] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.310926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.310926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.311100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.311190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.311288] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 815.339730] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.339924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.339924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.340158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.340304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.349323] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 815.531275] env[65119]: INFO networking_nsxv3.common.synchronization [req-5c4ad4f4-40b8-4624-9086-97e4b3c0179f req-fad3da59-49af-4ea6-83e6-3172aeace1f4 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 815.531458] env[65119]: INFO networking_nsxv3.common.synchronization [req-5c4ad4f4-40b8-4624-9086-97e4b3c0179f req-fad3da59-49af-4ea6-83e6-3172aeace1f4 service nova] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 815.531633] env[65119]: INFO networking_nsxv3.common.synchronization [req-5c4ad4f4-40b8-4624-9086-97e4b3c0179f req-fad3da59-49af-4ea6-83e6-3172aeace1f4 service nova] Enqueued Resource ID: a6cab26a-04ed-4424-a612-b8bb8525e252 with Priority: HIGHEST for action port [ 815.532182] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_rules [ 815.532320] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 815.532425] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cab26a-04ed-4424-a612-b8bb8525e252 with Priority: HIGHEST for action port [ 815.532685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.532804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.532875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.533080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.533526] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.534165] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.534165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.534316] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6cab26a-04ed-4424-a612-b8bb8525e252 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.534415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.534479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.534655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.534736] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6cab26a-04ed-4424-a612-b8bb8525e252',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.037377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.037553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.037771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6cab26a-04ed-4424-a612-b8bb8525e252 with status ACTIVE [ 816.037953] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.038112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.038228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.038482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.038580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.038759] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.038857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.038926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.039144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.039226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.039416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.039520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.039583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.039723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.039798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.039884] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6cab26a-04ed-4424-a612-b8bb8525e252 is going to be updated. [ 816.070676] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.070913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.070994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.071230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.071389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.071559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6cab26a-04ed-4424-a612-b8bb8525e252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.390064] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 816.390350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.361867] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 817.361867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.361867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.361867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.362237] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.362237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.362237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.362432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.362476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.362977] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.869448] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.374049] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.877042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.877042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.877042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.877496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.877496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.877496] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 818.912242] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.912474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.912474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.912744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.912872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.926186] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 820.533515] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 820.533951] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 820.939406] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 820.939406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.939565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.940426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.940426] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.940767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.940906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.941586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.941586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.941586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.941586] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.444416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.444622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.444622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.445852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.445852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.445852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.446402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.446402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.446402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.446402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.446567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.446608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.446875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.446875] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.950595] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4688087-743d-4d09-ac40-3272e1f90bc5: rpc.has_security_group_logging(os_id): False [ 821.971315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.971505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.971505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.971813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.992076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.992363] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.992623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.992623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.992812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.992909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.993150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.993248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.993313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.993623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.993623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.995184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.995184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.995184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.995184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.995184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.995184] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 822.062616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.062869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.062959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.063169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.063321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.077377] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 823.114545] env[65119]: INFO networking_nsxv3.common.synchronization [req-a3e58ca0-5bdf-485c-a938-d089c93743b7 req-8c016f99-b6a3-41da-bb4a-0d80e84fb3a4 tempest-ListImageFiltersTestJSON-1838690385 tempest-ListImageFiltersTestJSON-1838690385-project-member] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 823.115115] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 823.115418] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.115549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.115616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.115806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.115946] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.116079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.116079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.116242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.116303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.116682] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.424118] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.424118] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.424349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.424730] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.424795] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.424961] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.425384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.425384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.425831] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.425831] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.425945] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.426066] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.426483] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.426483] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.426483] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.426674] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.447344] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.447571] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.447752] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.447964] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.448610] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.448610] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.448808] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.449268] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.449472] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6445072c-66ff-4a9e-b1ce-aee8d7f1681d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.618438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.951913] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.952183] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.952268] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.952562] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.952717] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.952870] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 6445072c-66ff-4a9e-b1ce-aee8d7f1681d not found, creating... [ 823.953157] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.953314] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.953427] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.953701] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.953846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.954142] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.954297] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.954411] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.954618] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.954749] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.954887] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 6445072c-66ff-4a9e-b1ce-aee8d7f1681d is going to be created. [ 823.981880] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.981880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.981880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.981880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.981880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.981880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.092765] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 824.092949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.121756] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.182917] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7b47de3a-94d8-4ab7-a227-846c9a5ca432 None None] Enqueued Resource ID: d44734d7-6da1-4518-9318-71d3dfc44e93 with Priority: HIGHEST for action port [ 824.184180] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44734d7-6da1-4518-9318-71d3dfc44e93 with Priority: HIGHEST for action port [ 824.184603] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d44734d7-6da1-4518-9318-71d3dfc44e93 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.184744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d44734d7-6da1-4518-9318-71d3dfc44e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.184813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d44734d7-6da1-4518-9318-71d3dfc44e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d44734d7-6da1-4518-9318-71d3dfc44e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185199] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d44734d7-6da1-4518-9318-71d3dfc44e93',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.626278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.626278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.626572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.627681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.627681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.627681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be updated. [ 824.664491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.665756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.666038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.666360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.666630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.686405] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 824.687554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d44734d7-6da1-4518-9318-71d3dfc44e93 [ 824.689351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.690116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.690116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.690116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.690116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.690116] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d44734d7-6da1-4518-9318-71d3dfc44e93 already deleted. [ 824.690116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d44734d7-6da1-4518-9318-71d3dfc44e93" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.786414] env[65119]: INFO networking_nsxv3.common.synchronization [req-a3e58ca0-5bdf-485c-a938-d089c93743b7 req-840b18fb-dca9-48d5-9c67-6e2c8c657ed4 service nova] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_rules [ 824.786619] env[65119]: INFO networking_nsxv3.common.synchronization [req-a3e58ca0-5bdf-485c-a938-d089c93743b7 req-840b18fb-dca9-48d5-9c67-6e2c8c657ed4 service nova] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 824.790030] env[65119]: INFO networking_nsxv3.common.synchronization [req-a3e58ca0-5bdf-485c-a938-d089c93743b7 req-840b18fb-dca9-48d5-9c67-6e2c8c657ed4 service nova] Enqueued Resource ID: 6445072c-66ff-4a9e-b1ce-aee8d7f1681d with Priority: HIGHEST for action port [ 824.790030] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_rules [ 824.790030] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 824.790030] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6445072c-66ff-4a9e-b1ce-aee8d7f1681d with Priority: HIGHEST for action port [ 824.790030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.790030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.790030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.790562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.790562] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.791270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.791419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.791639] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.791792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.791842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.792014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.792095] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6445072c-66ff-4a9e-b1ce-aee8d7f1681d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.294051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.294328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.294328] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6445072c-66ff-4a9e-b1ce-aee8d7f1681d with status ACTIVE [ 825.294548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.294630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.294668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.294875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.294973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.295281] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.295385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.295448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.295606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.295686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.295881] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.295976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.296062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.296897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.296897] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.296897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6445072c-66ff-4a9e-b1ce-aee8d7f1681d is going to be updated. [ 825.322192] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.322342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.322410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.322623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.322760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.322917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6445072c-66ff-4a9e-b1ce-aee8d7f1681d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.721505] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e85752f8-97c0-42a1-b1d9-83e4057d9d13 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 825.722140] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 825.722466] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.722591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.722655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.722997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.723085] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.821923] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9f8c8fd6-2514-443f-aa31-2a2d03649c14 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 825.822549] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 825.823322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.823487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.250206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.250720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.252560] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568eca14-d302-4960-af0c-9198176e727f already deleted. [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.252560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.252560] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.697039] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 826.697325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.698105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.698105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.698105] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.698105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.698105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.698369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.698369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.698369] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.704928] env[65119]: INFO networking_nsxv3.common.synchronization [None req-cfd4358e-6e21-4781-9a19-1273701686e3 None None] Enqueued Resource ID: 26af183a-f08f-490e-a3b7-8becf5aeea6a with Priority: HIGHEST for action port [ 826.705048] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26af183a-f08f-490e-a3b7-8becf5aeea6a with Priority: HIGHEST for action port [ 826.705352] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-26af183a-f08f-490e-a3b7-8becf5aeea6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.705468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26af183a-f08f-490e-a3b7-8becf5aeea6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.706038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26af183a-f08f-490e-a3b7-8becf5aeea6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.706038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26af183a-f08f-490e-a3b7-8becf5aeea6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.706038] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26af183a-f08f-490e-a3b7-8becf5aeea6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.780449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.780846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.780846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.781051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.781051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.781187] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568eca14-d302-4960-af0c-9198176e727f already deleted. [ 826.781256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.201179] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.207988] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26af183a-f08f-490e-a3b7-8becf5aeea6a [ 827.208365] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.208540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.208591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.208805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.208890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.208986] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26af183a-f08f-490e-a3b7-8becf5aeea6a already deleted. [ 827.209082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26af183a-f08f-490e-a3b7-8becf5aeea6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.705763] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.870308] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-bf7765a3-40a7-4c32-b2fd-172d61d31520 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 827.872486] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 827.872486] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.872486] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.872486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.873170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.873593] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.203790] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.203790] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.203790] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.203790] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.204309] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.204407] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.204547] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.204782] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.204939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.205208] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.205382] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.205509] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.205618] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.205731] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.205865] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.206069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.207541] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.207674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.207736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.207867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.207956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.208087] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be updated. [ 828.234586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.234943] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.235165] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.235401] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.235842] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-f3486d2f-a67f-4446-a569-a8f636b2799b taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.236343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.236744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.236870] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3486d2f-a67f-4446-a569-a8f636b2799b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.243121] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.243121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.243121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.243490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.243637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.252734] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 828.375770] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.375853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.375892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.376131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.376226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.376446] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.376557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.376614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.376778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.376890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.376940] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 already deleted. [ 828.377062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.741489] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.741489] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.742164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.742164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.742164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.742502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port f3486d2f-a67f-4446-a569-a8f636b2799b not found, creating... [ 828.742627] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.742735] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.742875] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.743588] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.744498] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.744498] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.744498] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.744498] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.744728] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.744869] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.745055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: f3486d2f-a67f-4446-a569-a8f636b2799b is going to be created. [ 828.767032] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.767032] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.767032] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.767306] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.767412] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.767640] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.524599] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-e46c2875-2d5a-48dd-9ea4-e46cd7017cc4 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 829.524894] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-e46c2875-2d5a-48dd-9ea4-e46cd7017cc4 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 829.525151] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-e46c2875-2d5a-48dd-9ea4-e46cd7017cc4 service nova] Enqueued Resource ID: f3486d2f-a67f-4446-a569-a8f636b2799b with Priority: HIGHEST for action port [ 829.525879] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 829.526097] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 829.526347] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3486d2f-a67f-4446-a569-a8f636b2799b with Priority: HIGHEST for action port [ 829.526813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.527190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.527190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.527358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.527451] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.529140] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.529140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.529140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.529140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.529494] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.529494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.529494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.529740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.529740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.529740] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.531821] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3486d2f-a67f-4446-a569-a8f636b2799b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.531821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.531821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.531821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.531821] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3486d2f-a67f-4446-a569-a8f636b2799b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.033768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.033768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.034083] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.035385] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3486d2f-a67f-4446-a569-a8f636b2799b with status ACTIVE [ 830.035566] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.035691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.035877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.036068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.036068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.036191] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.036284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.036366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.036705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.036705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.036937] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.036937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.036937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.037150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.040466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.040466] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3486d2f-a67f-4446-a569-a8f636b2799b is going to be updated. [ 830.062412] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.062520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.062603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.062821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.062961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.063159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3486d2f-a67f-4446-a569-a8f636b2799b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.262869] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 830.263734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.264363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.264596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.264800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.264921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.264983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.265155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.265230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.265315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.265409] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.493494] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-e5c65619-94d1-42a7-bc65-d5751b30cf24 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 830.494575] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 830.494575] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.494575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.542634] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.632246] env[65119]: INFO networking_nsxv3.common.synchronization [req-59e62acb-0109-4d1b-a55a-22e43cbc7014 req-d2b43fb9-95b0-47b4-995b-94a7fec87579 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 830.632444] env[65119]: INFO networking_nsxv3.common.synchronization [req-59e62acb-0109-4d1b-a55a-22e43cbc7014 req-d2b43fb9-95b0-47b4-995b-94a7fec87579 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 830.632550] env[65119]: INFO networking_nsxv3.common.synchronization [req-59e62acb-0109-4d1b-a55a-22e43cbc7014 req-d2b43fb9-95b0-47b4-995b-94a7fec87579 tempest-SecurityGroupsTestJSON-603642226 tempest-SecurityGroupsTestJSON-603642226-project-member] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 830.633130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 with Priority: HIGHEST for action security_group_members [ 830.633287] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a with Priority: HIGHEST for action security_group_members [ 830.633381] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGHEST for action security_group_members [ 830.633707] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f74596-fb6a-47cf-899d-a4910bf5e050 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.633848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.633929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.634150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.634309] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.634408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.634469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.634616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.634720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.634792] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f74596-fb6a-47cf-899d-a4910bf5e050',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.635616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.635733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.635795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.635933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.636303] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.636431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.636504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.636648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.636720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.636809] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.637639] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.637779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.637848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.638232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.638232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.638320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.638396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.638631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.638716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.638827] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.767836] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.767990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.768081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.768307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.768500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.768608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.768673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.768822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.768909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.768995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.769155] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.769246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.769307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.769481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.769580] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.769671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.769731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.769863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.769937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.770025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.770114] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.830547] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.830846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.830918] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.831180] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.831439] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.831598] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.831713] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.831958] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.832127] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.832334] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.832438] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.832548] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.832657] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.832765] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.832868] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.832999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.864900] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.864900] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.864900] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.864900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.864900] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.864900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.864900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.864900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.864900] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4e2ae5-ddc0-447b-8b58-4072e096b1db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.045278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.045616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.045616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.046409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.046546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.046661] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be created. [ 831.095342] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.095578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.095578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.095762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.095935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.110933] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: UNINITIALIZED for 2s [ 831.143913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.143913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.143913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.143913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.143913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.144465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.144584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.144681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164360] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164708] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a is going to be updated. [ 831.165737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.166302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.186359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.186474] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.186595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.186688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.186857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.186951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.187049] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 is going to be updated. [ 831.188072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.188182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.188268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.188461] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.188579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.188647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.188788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.188865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.188949] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be updated. [ 831.197931] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.198088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.198159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.198354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.198524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.206480] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: IN_PROGRESS for 2s [ 831.220359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.220660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.220660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.220880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.220993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.222861] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.222981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.223108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.223332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.223464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.233594] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: IN_PROGRESS for 2s [ 831.234625] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: IN_PROGRESS for 2s [ 831.272850] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a096698e-b6ff-45f7-a422-2ae93392dd6a: rpc.has_security_group_logging(os_id): False [ 831.290331] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.290499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.290570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.290815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.290909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.291066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.291178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.291240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.291444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.291498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.291664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.291755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.291819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.291998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.292125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.292319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.292414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.292470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.292612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.292690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.292797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be updated. [ 831.358225] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.358425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.358548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.358771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.358919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.366990] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.367221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.367355] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.367619] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.367762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.367912] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port cc4e2ae5-ddc0-447b-8b58-4072e096b1db not found, creating... [ 831.368179] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.368342] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.368485] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.368768] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.368943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.369247] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.369432] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.369607] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.369880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.370063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.370231] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: cc4e2ae5-ddc0-447b-8b58-4072e096b1db is going to be created. [ 831.379855] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 831.396210] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.396475] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.396610] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.396904] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.397148] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.397376] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.125918] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-220e281f-359c-45bb-8ebe-1d85cbb7ce7d service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 832.126192] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-220e281f-359c-45bb-8ebe-1d85cbb7ce7d service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 832.126320] env[65119]: INFO networking_nsxv3.common.synchronization [req-b6a14f2a-38a1-4043-95be-71f16742712f req-220e281f-359c-45bb-8ebe-1d85cbb7ce7d service nova] Enqueued Resource ID: cc4e2ae5-ddc0-447b-8b58-4072e096b1db with Priority: HIGHEST for action port [ 832.126821] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 832.126935] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 832.127075] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc4e2ae5-ddc0-447b-8b58-4072e096b1db with Priority: HIGHEST for action port [ 832.127570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.127570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.127700] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.127700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.127883] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.127953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.128020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.128268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.128371] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4e2ae5-ddc0-447b-8b58-4072e096b1db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.630319] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc4e2ae5-ddc0-447b-8b58-4072e096b1db with status ACTIVE [ 832.631254] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.631254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.631254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.631254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.631688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.631688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.631784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.631824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.631971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.632091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.632244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.632338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.632393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.632545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.632620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.633407] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc4e2ae5-ddc0-447b-8b58-4072e096b1db is going to be updated. [ 832.656840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.657018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.657097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.657368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.657520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.657750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc4e2ae5-ddc0-447b-8b58-4072e096b1db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.123808] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 833.124185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.124339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.124543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.124730] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.124854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.124924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.125073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.125157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.125286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.125331] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.126214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.126492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.127041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.127041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.127041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.127041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.127041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.127297] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.222783] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a in Status: SUCCESS [ 833.223253] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a deletion is rescheduled due to dependency. [ 833.223389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.267042] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 in Status: SUCCESS [ 833.267042] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 deletion is rescheduled due to dependency. [ 833.267181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.267817] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 in Status: SUCCESS [ 833.269334] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f74596-fb6a-47cf-899d-a4910bf5e050 deletion is rescheduled due to dependency. [ 833.269456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f74596-fb6a-47cf-899d-a4910bf5e050" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.395404] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 833.395674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.629223] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.629404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.629664] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.131967] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.226582] env[65119]: INFO networking_nsxv3.common.synchronization [req-544d229b-3ed5-403e-b2ec-eea52ef381a8 req-b8f483db-036e-4917-9c9f-a0ab4eae9da0 tempest-ServerGroupTestJSON-648217425 tempest-ServerGroupTestJSON-648217425-project-member] Enqueued Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 834.227456] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 834.228697] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.228832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.228905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.229243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.229828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.229974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.230069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.230233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.230320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.230416] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.600331] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.600519] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-129" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.600638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-129" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.601023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-129" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.601285] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.601440] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.601555] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.601806] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.601934] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.603032] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.603032] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.603032] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.603032] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.603318] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.603318] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.603422] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.627173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.627363] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.627501] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.627679] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-129" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.628013] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.628191] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.628308] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.628743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.628884] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.636169] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.636314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.636392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.636707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.636837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.636887] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 834.673334] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.673522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.673586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.673806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.673948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.683901] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 834.733452] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.733646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.733646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.733983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.734091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.734298] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.734407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.734472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.734624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.734699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.734779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 already deleted. [ 834.734858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.132581] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.132978] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.133058] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.133354] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.133462] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.133618] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 not found, creating... [ 835.133890] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.134062] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.134178] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.134397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.134531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.134805] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.134957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.135277] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.135512] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.135645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.135783] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 is going to be created. [ 835.156236] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.156469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.156578] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.156845] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.157094] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.157327] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.893593] env[65119]: INFO networking_nsxv3.common.synchronization [req-544d229b-3ed5-403e-b2ec-eea52ef381a8 req-8023f64a-b2d0-43e6-8429-085af6b2f23b service nova] Enqueued Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_rules [ 835.893822] env[65119]: INFO networking_nsxv3.common.synchronization [req-544d229b-3ed5-403e-b2ec-eea52ef381a8 req-8023f64a-b2d0-43e6-8429-085af6b2f23b service nova] Enqueued Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 835.893973] env[65119]: INFO networking_nsxv3.common.synchronization [req-544d229b-3ed5-403e-b2ec-eea52ef381a8 req-8023f64a-b2d0-43e6-8429-085af6b2f23b service nova] Enqueued Resource ID: be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 with Priority: HIGHEST for action port [ 835.894581] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_rules [ 835.894682] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 835.894785] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 with Priority: HIGHEST for action port [ 835.896736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.896736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.896736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.897067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.897229] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.898814] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.899018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.899240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.902362] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.902362] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.902362] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.902362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.902362] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.403349] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.404839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.405671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.405882] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 with status ACTIVE [ 836.406120] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.406268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.406334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.406633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.406768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.406984] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.408369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.408369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.408369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.408369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.408644] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.408644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.409061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.409061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.409061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.409061] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3 is going to be updated. [ 836.442653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.442861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.442910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.443140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.443311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.443555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be6c0e2a-b7e7-4a2c-a5ce-d5ad2a41a5b3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.696195] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 836.696434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.696684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.696905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.697145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.697220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.697285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.697456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.697504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.697625] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.907464] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.200742] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.412381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.412838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.412838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.412935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.413070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.413209] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 is going to be created. [ 837.442813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.443030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.443106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.443532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.443588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.457951] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: UNINITIALIZED for 2s [ 837.703202] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.207348] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.207504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.207671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.207860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.207998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.208117] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 838.237592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.237761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.237812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.238057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.238228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.247766] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 839.471317] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: SUCCESS [ 839.471708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.471788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.471963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.472180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.472342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.472414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.472570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.472633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.472694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.472780] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.976789] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.976789] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.976789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.978221] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.978221] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.978221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.978221] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.151567] env[65119]: INFO networking_nsxv3.common.synchronization [req-e4ac5465-6b3d-4e67-87da-d570b354695d req-da9efb5b-3601-47e7-a117-7d679ab7809c tempest-ServersV294TestFqdnHostnames-1932911180 tempest-ServersV294TestFqdnHostnames-1932911180-project-member] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 840.152139] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGHEST for action security_group_members [ 840.154959] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.155185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.155298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.155654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.155954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.156152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.156278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.156559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.156720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.156895] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.259011] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 840.259316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.259557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.259809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.260489] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.260489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.260489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.260489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.260489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.260489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.261033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.261033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.261033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.261033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.261239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.261239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.261239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.261349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.261427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.261481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.261568] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.480155] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11551b08-d7e5-440b-b40c-112c2d7e5430: rpc.has_security_group_logging(os_id): False [ 840.504504] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.504504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.504504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.505740] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.505740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.506149] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.506149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.509111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.511927] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.511927] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 is going to be created. [ 840.598138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.598138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.598138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.598138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.598138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.617428] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: IN_PROGRESS for 2s [ 840.664707] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.665089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.665089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.665365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.665403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.666072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.666072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.666072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.666072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.666307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.666307] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 is going to be updated. [ 840.733328] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.733518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.733568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.733831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.733977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.755954] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: IN_PROGRESS for 2s [ 840.764503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c4bf50-a472-475c-9016-e8ba33d62ca9: rpc.has_security_group_logging(os_id): False [ 840.792612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.792612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.792612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.793637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.793637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.794032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.794186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.794272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.797978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.797978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.797978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be created. [ 840.890210] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.890210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.890210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.890210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.890430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.924956] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 842.382615] env[65119]: INFO networking_nsxv3.common.synchronization [req-f8880133-92f3-47f4-b5f1-9ac8b35aef9f req-fcb2d7ba-bfbb-476e-a148-64e506f39ab0 tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 842.383481] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 842.383909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.384065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.384116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.384372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.384532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.384652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.384699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.384839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.384923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.385027] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.638018] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: SUCCESS [ 842.638305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.771046] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 in Status: SUCCESS [ 842.771141] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 deletion is rescheduled due to dependency. [ 842.771230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.814730] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.814730] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.815424] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.815424] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.815574] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.815706] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.815826] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.816116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.816375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.816462] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.816536] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.816649] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.816788] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.816970] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.817150] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.817340] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.840999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.841315] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.841543] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.841749] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.842144] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.842428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.842606] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.842939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.843089] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e94b3b-5f3b-45e9-8c54-c5037d3603b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.887162] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.887403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.887500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.887705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.887795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.888013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.888123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.888183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.888361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.888437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.888555] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 already deleted. [ 842.889911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.941107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 842.941585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.941717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.942013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.942193] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.345833] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.346095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.346255] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.346680] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.346991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.346991] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 not found, creating... [ 843.347479] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.347666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.347791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.348105] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.348346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.348751] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.348987] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.349183] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.349419] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.349651] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.349884] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 is going to be created. [ 843.378819] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.379078] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.379188] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.379464] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.379721] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.380139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.445476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.445834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.445834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.445834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.446053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.446181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.446269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.446466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.446582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.446736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.446797] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.949669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.949984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.949984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.950097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.950270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.950415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.950575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.950755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.950900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.950977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.951188] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.951329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.951409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.951585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.951773] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.951907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.951997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.952746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.952828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.952917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.953048] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [req-f8880133-92f3-47f4-b5f1-9ac8b35aef9f req-e3f93cd4-7cf4-4894-8886-0884c10414e9 service nova] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [req-f8880133-92f3-47f4-b5f1-9ac8b35aef9f req-e3f93cd4-7cf4-4894-8886-0884c10414e9 service nova] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [req-f8880133-92f3-47f4-b5f1-9ac8b35aef9f req-e3f93cd4-7cf4-4894-8886-0884c10414e9 service nova] Enqueued Resource ID: a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 with Priority: HIGHEST for action port [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 844.086025] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 with Priority: HIGHEST for action port [ 844.086025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.086025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.088472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.088770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.088965] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.091580] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.091580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.091580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.091580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.091580] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.091580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.091580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.095089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.095190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.095496] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.098026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.098026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.098026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.098026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.098026] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e94b3b-5f3b-45e9-8c54-c5037d3603b5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.192863] env[65119]: INFO networking_nsxv3.common.synchronization [None req-da21f908-c94e-4d2f-a1c7-0602956a744e None None] Enqueued Resource ID: 8cd2645b-778b-4acf-bc69-17c0b334f6a1 with Priority: HIGHEST for action port [ 844.193568] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cd2645b-778b-4acf-bc69-17c0b334f6a1 with Priority: HIGHEST for action port [ 844.193905] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cd2645b-778b-4acf-bc69-17c0b334f6a1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.194241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cd2645b-778b-4acf-bc69-17c0b334f6a1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.194382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cd2645b-778b-4acf-bc69-17c0b334f6a1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.194695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cd2645b-778b-4acf-bc69-17c0b334f6a1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.194784] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cd2645b-778b-4acf-bc69-17c0b334f6a1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.386242] env[65119]: INFO networking_nsxv3.common.synchronization [req-acc06b69-485c-4370-892a-f37998f96a56 req-4c4a12de-414a-4d9e-a367-be8f81a0b048 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 844.387204] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 844.387376] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.387560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.387634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.387885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.387997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.388378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.388441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.388714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.388843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.389956] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.455386] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c4bf50-a472-475c-9016-e8ba33d62ca9: rpc.has_security_group_logging(os_id): False [ 844.481627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.481627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.481627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.481627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.482258] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.482258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.482258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.482258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.482258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.482258] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 844.564808] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.564967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.565075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.565332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.565508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.582054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 844.599254] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.599415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.599693] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.601239] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 with status ACTIVE [ 844.601505] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.601767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.601845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.605331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.605452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.605687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.605803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.605878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.606194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.606301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.607420] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.607420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.607420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.607420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.607420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.607420] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6e94b3b-5f3b-45e9-8c54-c5037d3603b5 is going to be updated. [ 844.643588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.643588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.643588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.643797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.643983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.644371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6e94b3b-5f3b-45e9-8c54-c5037d3603b5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.698628] env[65119]: INFO networking_nsxv3.common.synchronization [req-f690629a-655a-4911-949d-7960677cbda4 req-0cf76166-35fb-4e5c-b705-8ccd09a21070 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 844.698926] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cd2645b-778b-4acf-bc69-17c0b334f6a1 [ 844.699153] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.699289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.699353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.699548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.699680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.699763] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cd2645b-778b-4acf-bc69-17c0b334f6a1 already deleted. [ 844.699836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cd2645b-778b-4acf-bc69-17c0b334f6a1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.700890] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 844.701307] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.701414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.891877] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.108803] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.395718] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.615114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.615114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.615114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.615114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.615114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.615114] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be created. [ 845.644296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.644296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.644296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.644296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.644296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.650382] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: UNINITIALIZED for 2s [ 845.900199] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.900986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.901127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.901403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.901501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.901622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 845.934061] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.934061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.934061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.934278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.934386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.944110] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 846.595830] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 846.595830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.289484] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3632567-6900-461b-afa8-3b108b7ea009 req-dd10b45c-8b0c-4185-89b8-bbbe5279b9d7 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 847.289759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 847.289996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.297023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.297023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.297023] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.378700] env[65119]: INFO networking_nsxv3.common.synchronization [None req-30b8ed1e-6722-4725-866d-7a0e0aa4f671 None None] Enqueued Resource ID: 348e7938-306a-42e7-af5f-d78a521e544f with Priority: HIGHEST for action port [ 847.378700] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 348e7938-306a-42e7-af5f-d78a521e544f with Priority: HIGHEST for action port [ 847.378700] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-348e7938-306a-42e7-af5f-d78a521e544f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.379153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-348e7938-306a-42e7-af5f-d78a521e544f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.379232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-348e7938-306a-42e7-af5f-d78a521e544f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.379495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-348e7938-306a-42e7-af5f-d78a521e544f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.379586] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348e7938-306a-42e7-af5f-d78a521e544f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.665233] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.665233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.665233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.665233] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.785384] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.785384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.785384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.786210] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.786714] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.787130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.787400] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.787874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.788215] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.788691] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.788948] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.789209] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.789484] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.789841] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.790075] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.792261] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.804596] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.804596] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.804596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.804596] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be deleted. [ 847.813973] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.814484] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.814896] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.815237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.815696] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-06ec1e07-0c65-43c4-a013-ec117797ce16 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.816365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.816365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.817512] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.817512] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ec1e07-0c65-43c4-a013-ec117797ce16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.839797] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.841080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.841080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.841080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.841312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.841312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.881865] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 348e7938-306a-42e7-af5f-d78a521e544f [ 847.882150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.882301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.882373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.882618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.882729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.882828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:348e7938-306a-42e7-af5f-d78a521e544f already deleted. [ 847.882912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-348e7938-306a-42e7-af5f-d78a521e544f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.956353] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 847.956569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.956754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.958336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.958336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.958336] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.167768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.319819] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.320247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.320593] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.320742] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.320966] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.321214] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 06ec1e07-0c65-43c4-a013-ec117797ce16 not found, creating... [ 848.321603] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.321841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.322038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.322367] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.322574] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.322988] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.323239] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.323420] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.323723] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.323925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.324148] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 06ec1e07-0c65-43c4-a013-ec117797ce16 is going to be created. [ 848.344619] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.344845] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.344967] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.345355] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.345586] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.345809] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.461233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.461469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.461588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.461857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.462007] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.462270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.462414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.462493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.462673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.462769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.462857] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 848.511282] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.511457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.511457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.511664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.511811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.523651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 848.621212] env[65119]: INFO networking_nsxv3.common.synchronization [req-340f9e6b-0e32-448c-b289-ca3856f26334 req-1348a239-2450-4f8a-8ff8-339fc3b65a2c tempest-ServerGroupTestJSON-648217425 tempest-ServerGroupTestJSON-648217425-project-member] Enqueued Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 848.621842] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGHEST for action security_group_members [ 848.622506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.622632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.622632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.622824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.622990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.623148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.623251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.623477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.623572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.623667] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.670673] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf1fd06-b056-4d16-b440-25af92d62920: rpc.has_security_group_logging(os_id): False [ 848.693762] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.694021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.694457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.694761] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.694878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.695195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.695273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.695375] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be created. [ 848.776682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.776934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.776934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.777155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.777344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.790130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 849.057561] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3632567-6900-461b-afa8-3b108b7ea009 req-21e0fd4e-0705-48fc-8da9-84989183b595 service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 849.057653] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3632567-6900-461b-afa8-3b108b7ea009 req-21e0fd4e-0705-48fc-8da9-84989183b595 service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 849.057808] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3632567-6900-461b-afa8-3b108b7ea009 req-21e0fd4e-0705-48fc-8da9-84989183b595 service nova] Enqueued Resource ID: 06ec1e07-0c65-43c4-a013-ec117797ce16 with Priority: HIGHEST for action port [ 849.058381] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 849.058686] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 849.058686] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ec1e07-0c65-43c4-a013-ec117797ce16 with Priority: HIGHEST for action port [ 849.058965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.059114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.059189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.059459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.059499] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.061220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.061220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.061220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.061628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.061628] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.064045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ec1e07-0c65-43c4-a013-ec117797ce16 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.064045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.064045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.064045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.064045] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ec1e07-0c65-43c4-a013-ec117797ce16',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.126697] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.126697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.126697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.127143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.127143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.127143] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.127284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.127284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.127603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.127603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.127724] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 is going to be updated. [ 849.161290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.161443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.161522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.161789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.161908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.171410] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: IN_PROGRESS for 2s [ 849.565040] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.565388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.565388] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.566399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06ec1e07-0c65-43c4-a013-ec117797ce16 with status ACTIVE [ 849.567292] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.567292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.567292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.567292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.567292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.567528] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.567528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.567528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.569988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.569988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.569988] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.569988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.569988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.570290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.570290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.570371] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06ec1e07-0c65-43c4-a013-ec117797ce16 is going to be updated. [ 849.577895] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.603510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.604408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.604408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.604408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.604408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.604408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ec1e07-0c65-43c4-a013-ec117797ce16" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.975332] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c203ce3b-4702-421d-aacf-f1e16696db20 None None] Enqueued Resource ID: 41b62e29-c0a2-44a1-ab2c-a1e3a522079d with Priority: HIGHEST for action port [ 849.975921] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b62e29-c0a2-44a1-ab2c-a1e3a522079d with Priority: HIGHEST for action port [ 849.976255] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b62e29-c0a2-44a1-ab2c-a1e3a522079d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.976483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b62e29-c0a2-44a1-ab2c-a1e3a522079d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.976483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b62e29-c0a2-44a1-ab2c-a1e3a522079d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.976934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b62e29-c0a2-44a1-ab2c-a1e3a522079d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.976934] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b62e29-c0a2-44a1-ab2c-a1e3a522079d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.038552] env[65119]: INFO networking_nsxv3.common.synchronization [req-b4b102e4-72fa-4b6d-bf6c-34b78e3a1010 req-c3331c30-055d-4451-b016-bd2a762eb135 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 850.039193] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 850.039507] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.040541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.040541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.040541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.040541] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.040541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.040541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.040889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.040889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.040889] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.080605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.081051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.081186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.081315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.081428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.081538] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 850.104146] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.104417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.104417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.104657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.104786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.116501] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: UNINITIALIZED for 2s [ 850.480234] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41b62e29-c0a2-44a1-ab2c-a1e3a522079d [ 850.480534] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.480910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.480910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.481523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.481523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.481523] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41b62e29-c0a2-44a1-ab2c-a1e3a522079d already deleted. [ 850.481523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b62e29-c0a2-44a1-ab2c-a1e3a522079d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.489238] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.489442] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.489571] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.489983] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.490230] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.490482] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.490482] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.491037] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.491185] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.491395] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.491532] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.491610] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.491741] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.491929] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.491929] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.492042] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.514963] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.515336] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.515593] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.515996] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.516469] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.516761] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.516827] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.517358] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517418] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e54ad26-05b5-4d03-82e6-cc5b7af90a88',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.532959] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 850.533166] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 deletion is rescheduled due to dependency. [ 850.533282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.542819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.542995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.543082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.543322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.543473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.543610] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.543716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.543776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.543936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.544036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.544118] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 already deleted. [ 850.544201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.810746] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 850.811256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.021723] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.021943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.022069] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.022356] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.022508] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 not found, creating... [ 851.022927] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.023103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.023221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.023450] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.023585] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.023869] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.024034] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.024154] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.024451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.024672] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.024883] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 is going to be created. [ 851.051462] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.051659] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.051961] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.052182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.052419] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.052655] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.199039] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 in Status: SUCCESS [ 851.199039] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 deletion is rescheduled due to dependency. [ 851.199039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.832728] env[65119]: INFO networking_nsxv3.common.synchronization [req-b4b102e4-72fa-4b6d-bf6c-34b78e3a1010 req-ef8d14a2-44bd-47d9-add0-bbf9d5c43bae service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 851.834844] env[65119]: INFO networking_nsxv3.common.synchronization [req-b4b102e4-72fa-4b6d-bf6c-34b78e3a1010 req-ef8d14a2-44bd-47d9-add0-bbf9d5c43bae service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 851.835017] env[65119]: INFO networking_nsxv3.common.synchronization [req-b4b102e4-72fa-4b6d-bf6c-34b78e3a1010 req-ef8d14a2-44bd-47d9-add0-bbf9d5c43bae service nova] Enqueued Resource ID: 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 with Priority: HIGHEST for action port [ 851.835667] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 851.835812] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 851.835912] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 with Priority: HIGHEST for action port [ 851.836840] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.837022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.838862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.838862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.838862] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.839556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.839715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.839820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.840129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.840431] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.840547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.840610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.840771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.843246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.843246] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.843246] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.843246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.843246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.843246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.843246] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e54ad26-05b5-4d03-82e6-cc5b7af90a88',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.130023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.130023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.130023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.130023] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.345474] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.345602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.345840] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.346881] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 with status ACTIVE [ 852.347086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.347215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.347290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.347479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.347562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.347737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.347838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.347898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.351540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.351540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.351540] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e54ad26-05b5-4d03-82e6-cc5b7af90a88 is going to be updated. [ 852.382388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.382524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.382524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.383031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.384250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.384355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e54ad26-05b5-4d03-82e6-cc5b7af90a88" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.633089] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.633554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.633554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.633684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.633792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.633886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.633950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.634707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.634964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.635088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.635260] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.635358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.635426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.635574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.635742] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.635829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.636534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.636534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.636534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.636534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.636534] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.717196] env[65119]: INFO networking_nsxv3.common.synchronization [req-53ac5b99-ff84-4083-8239-4054fbf1ca3e req-4dd68649-6f3d-4b77-b107-de201dcf2785 tempest-ServersTestManualDisk-260502750 tempest-ServersTestManualDisk-260502750-project-member] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 852.717862] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 852.718270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.719229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.719396] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.719501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.719579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.719995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.719995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.720112] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.803293] env[65119]: INFO networking_nsxv3.common.synchronization [None req-f52a9760-b9bb-4cb4-bc2c-074d5a7f829d None None] Enqueued Resource ID: 33cdb35f-f949-481a-b657-efb297c1c0ce with Priority: HIGHEST for action port [ 852.804131] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cdb35f-f949-481a-b657-efb297c1c0ce with Priority: HIGHEST for action port [ 852.804960] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-33cdb35f-f949-481a-b657-efb297c1c0ce taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.804960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33cdb35f-f949-481a-b657-efb297c1c0ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.804960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33cdb35f-f949-481a-b657-efb297c1c0ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.804960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33cdb35f-f949-481a-b657-efb297c1c0ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.804960] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33cdb35f-f949-481a-b657-efb297c1c0ce',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.853826] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.057620] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.057916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.057916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.058204] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.058454] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.058663] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.058858] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.059192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.059697] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.059697] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.059697] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.059976] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.059976] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.059976] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.060803] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.060803] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.081209] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.081599] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.081599] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.082014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.082262] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-faddeea9-862d-4178-b751-bd1e465d48a7 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.082465] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.082619] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.083040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.083953] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faddeea9-862d-4178-b751-bd1e465d48a7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.139431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154abdb7-4268-41a3-bf4b-26f5e9656c76: rpc.has_security_group_logging(os_id): False [ 853.159611] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.159804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.159898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.160127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.160219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.160413] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.160510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.160572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.160722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.164021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.164021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.164021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.164021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 853.219272] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.219473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.219473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.219678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.219871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.222624] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.222791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.222840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.223100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.223202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.223393] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.223495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.223558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.223709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.223787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.223890] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 already deleted. [ 853.224025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.234699] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 853.308678] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33cdb35f-f949-481a-b657-efb297c1c0ce [ 853.308947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.309123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.309195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.309418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.309512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.309612] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33cdb35f-f949-481a-b657-efb297c1c0ce already deleted. [ 853.309791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33cdb35f-f949-481a-b657-efb297c1c0ce" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.356571] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.356799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.356924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.357105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.357199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.357299] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be created. [ 853.416974] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.417233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.417233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.417439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.417600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.428219] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: UNINITIALIZED for 2s [ 853.587135] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.587531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.587778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.588167] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.588329] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.588970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port faddeea9-862d-4178-b751-bd1e465d48a7 not found, creating... [ 853.588970] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.588970] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.589359] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.589359] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.589494] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.589825] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.590554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.590720] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.594267] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.594267] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.594267] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: faddeea9-862d-4178-b751-bd1e465d48a7 is going to be created. [ 853.618470] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.618781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.618912] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.620267] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.620594] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.624323] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367056] env[65119]: INFO networking_nsxv3.common.synchronization [req-53ac5b99-ff84-4083-8239-4054fbf1ca3e req-03a894aa-7bb0-48cf-8b9f-2d9ec4df1a88 service nova] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 854.367430] env[65119]: INFO networking_nsxv3.common.synchronization [req-53ac5b99-ff84-4083-8239-4054fbf1ca3e req-03a894aa-7bb0-48cf-8b9f-2d9ec4df1a88 service nova] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 854.367509] env[65119]: INFO networking_nsxv3.common.synchronization [req-53ac5b99-ff84-4083-8239-4054fbf1ca3e req-03a894aa-7bb0-48cf-8b9f-2d9ec4df1a88 service nova] Enqueued Resource ID: faddeea9-862d-4178-b751-bd1e465d48a7 with Priority: HIGHEST for action port [ 854.368406] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_rules [ 854.368624] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 854.368930] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faddeea9-862d-4178-b751-bd1e465d48a7 with Priority: HIGHEST for action port [ 854.369393] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.369524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.369685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.370047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.370241] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.372084] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.372211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.372278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.372547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.372730] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.372912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.373040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.373310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.373452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.373666] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.375273] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-faddeea9-862d-4178-b751-bd1e465d48a7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.375460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.375566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.375768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.375945] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faddeea9-862d-4178-b751-bd1e465d48a7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.636444] env[65119]: INFO networking_nsxv3.common.synchronization [req-983774cc-392d-4b0e-b982-23c1906a652c req-fb15e2b9-ccf3-48e5-bf1b-df5f82ef82d8 tempest-ServersTestFqdnHostnames-1879836506 tempest-ServersTestFqdnHostnames-1879836506-project-member] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 854.637136] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGHEST for action security_group_members [ 854.637526] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.637648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.637711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.637943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.638109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.638205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.638265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.639134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.639134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.639134] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.877973] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.878197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.878382] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.880041] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faddeea9-862d-4178-b751-bd1e465d48a7 with status ACTIVE [ 854.880248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.881567] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.881567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.882147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.882370] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.882370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.882617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.882617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.883170] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faddeea9-862d-4178-b751-bd1e465d48a7 is going to be updated. [ 854.911043] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.911214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.911287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.911500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.911642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.911860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faddeea9-862d-4178-b751-bd1e465d48a7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.142268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.142268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.142268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.142268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.142268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.142606] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.142606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.142606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.142736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.142736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.142804] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 is going to be updated. [ 855.174800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.174800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.174800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.174800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.174800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.183246] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: IN_PROGRESS for 2s [ 855.250322] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 855.250322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.386302] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.442246] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 855.442507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.442710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.442967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.443202] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.443360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.443433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.443618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.443702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.443782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.443867] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.894997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.894997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.894997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.894997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.894997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.894997] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 is going to be created. [ 855.919350] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.919546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.919603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.919802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.919975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.930376] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: UNINITIALIZED for 2s [ 855.948102] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.213111] env[65119]: INFO networking_nsxv3.common.synchronization [req-7eee1206-a82f-4ba4-8878-5acb741d8fc7 req-599cbfd7-467d-48b0-afa1-daf91be1380a tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 856.213699] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 856.214629] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.214812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.214957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.215209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.215414] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.215606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.215650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.215807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.215921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.216052] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.450498] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ce292fb-ef03-4deb-8b4d-98b3ea31c815: rpc.has_security_group_logging(os_id): False [ 856.476022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.476022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.476022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.476022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be created. [ 856.548179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.548179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.548179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.548179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.548179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.562191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 856.719082] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.193841] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 in Status: SUCCESS [ 857.194051] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 deletion is rescheduled due to dependency. [ 857.194172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.221964] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.724802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.725149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.725210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.726573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.726573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.726573] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 857.754758] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.754949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.754949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.755408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.755408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.764548] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 857.949986] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: SUCCESS [ 857.950273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.950453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.950719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.951966] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.951966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.951966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.952406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.952406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.952406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.952589] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.458311] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.581442] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 858.581581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.960842] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb24203d-c552-4146-a5ac-8b7d840c9508: rpc.has_security_group_logging(os_id): False [ 858.980834] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.980998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.981094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.981316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.981407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.981972] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.981972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.981972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.981972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.982251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.982251] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 is going to be created. [ 859.045648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.045648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.045648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.045648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.045648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.060569] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: IN_PROGRESS for 2s [ 859.780954] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 859.781275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.079126] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: SUCCESS [ 861.079618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.214853] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 861.214853] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 863.718174] env[65119]: INFO networking_nsxv3.common.synchronization [req-0403c83e-3d47-4021-841c-b5b8f3f00f8a req-7f1f23ff-15d2-4b78-9a23-dc7d36fda5a7 tempest-ListServerFiltersTestJSON-409743125 tempest-ListServerFiltersTestJSON-409743125-project-member] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 863.718784] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGHEST for action security_group_members [ 863.719379] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.719650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.719650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.719920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.720113] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.720213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.720292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.720416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.720500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.720593] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.224011] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.224011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.224011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.224011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.248208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.248864] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.248864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.248864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.249135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.249135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.249135] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be updated. [ 864.282857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.283090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.283145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.283332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.283477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.296849] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: IN_PROGRESS for 2s [ 864.516044] env[65119]: INFO networking_nsxv3.common.synchronization [req-b19a7660-220b-40fd-9b4b-85d4c1483d15 req-87d91258-86f6-4a85-8e69-7bdf7b43347b tempest-FloatingIPsAssociationTestJSON-1574037461 tempest-FloatingIPsAssociationTestJSON-1574037461-project-member] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 864.517351] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGHEST for action security_group_members [ 864.517351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.517542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.517542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.517710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.517853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.518018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.518069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.518201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.518812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.519126] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.023283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.025521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.025521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.025521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be updated. [ 865.058699] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.058878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.060326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.060326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.060326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.069493] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: IN_PROGRESS for 2s [ 866.314244] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a in Status: SUCCESS [ 866.314818] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a deletion is rescheduled due to dependency. [ 866.314818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.080521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 in Status: SUCCESS [ 867.080814] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 deletion is rescheduled due to dependency. [ 867.080986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.518489] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 869.518919] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 869.930061] env[65119]: INFO networking_nsxv3.common.synchronization [req-54128883-393c-4e47-bb92-b5b2a2f82b29 req-03ada340-b93f-4278-95aa-79364d929708 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 869.930622] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 869.930940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.931106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.931404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.931452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.931632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.931737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.931799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.931969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.932090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.932218] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.299984] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-358 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.300336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.300336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.300784] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.300825] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.300966] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.301399] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.302349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.302349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.302349] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.302349] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.302349] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.302349] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.302645] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.302645] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.302645] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.323779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.325090] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.325090] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.325295] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.325688] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-6af614e8-365a-4dd7-bd1a-336654b80756 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.325925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.326108] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.326896] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.327081] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af614e8-365a-4dd7-bd1a-336654b80756',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.435748] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.829965] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.830451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.830451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.831516] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.831762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.831940] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 6af614e8-365a-4dd7-bd1a-336654b80756 not found, creating... [ 870.832300] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.832469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.832639] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.832899] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.833429] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.833963] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.834324] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.834614] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.835078] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.835242] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.835392] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 6af614e8-365a-4dd7-bd1a-336654b80756 is going to be created. [ 870.858720] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.859049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.859182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.859457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.859717] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.860035] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.939689] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.442593] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.442772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.442847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.443162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.443263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.443368] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 871.478401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.478590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.478740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.478921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.479834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.490859] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 871.628509] env[65119]: INFO networking_nsxv3.common.synchronization [req-54128883-393c-4e47-bb92-b5b2a2f82b29 req-a35846ed-4cf8-4c46-928e-73cd8edee2d5 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 871.628509] env[65119]: INFO networking_nsxv3.common.synchronization [req-54128883-393c-4e47-bb92-b5b2a2f82b29 req-a35846ed-4cf8-4c46-928e-73cd8edee2d5 service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 871.628509] env[65119]: INFO networking_nsxv3.common.synchronization [req-54128883-393c-4e47-bb92-b5b2a2f82b29 req-a35846ed-4cf8-4c46-928e-73cd8edee2d5 service nova] Enqueued Resource ID: 6af614e8-365a-4dd7-bd1a-336654b80756 with Priority: HIGHEST for action port [ 871.628720] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 871.630796] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 871.630796] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6af614e8-365a-4dd7-bd1a-336654b80756 with Priority: HIGHEST for action port [ 871.630796] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.630796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.630796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.630796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.630796] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.633625] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.633625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.633889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6af614e8-365a-4dd7-bd1a-336654b80756 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.633889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.633978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.634234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.634353] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af614e8-365a-4dd7-bd1a-336654b80756',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.137857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.138298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.138298] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6af614e8-365a-4dd7-bd1a-336654b80756 with status ACTIVE [ 872.138425] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.138425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.139023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.139023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.139023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.139183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.139183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.139342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.139394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.139481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.139620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.140820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.140820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.140820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.140820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.140820] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6af614e8-365a-4dd7-bd1a-336654b80756 is going to be updated. [ 872.164669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.164855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.164911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.165207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.165367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.165528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6af614e8-365a-4dd7-bd1a-336654b80756" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.502668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 873.503013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.503216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.503534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.503777] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.503936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.504011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.504204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.504307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.504420] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.510215] env[65119]: INFO networking_nsxv3.common.synchronization [req-b777484c-02a5-44fc-b044-284e28b11389 req-32455afe-0adb-4d04-9e3f-53e1184754e9 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 873.510738] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 873.510738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.510898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.510943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.511367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.511638] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.511638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.511716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.512263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.512263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.512263] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.897690] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.897888] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.898026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.898345] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.898666] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.898860] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.898994] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.899269] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.900379] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.900379] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.900379] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.900379] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.900379] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.900379] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.900379] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.900379] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.920093] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.920281] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.920418] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.920585] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.920900] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-419393b2-9d3d-4758-b2b7-071e2efbd475 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.921083] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.921234] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.921562] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.921704] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419393b2-9d3d-4758-b2b7-071e2efbd475',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.007765] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.014780] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.015032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.015032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.015217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.015302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.015699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.015699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.015782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.015851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.015934] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568eca14-d302-4960-af0c-9198176e727f already deleted. [ 874.016026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.220276] env[65119]: INFO networking_nsxv3.common.synchronization [None req-bed768f5-bb9b-4d40-9567-5765afba0c19 None None] Enqueued Resource ID: b74b3959-7779-4599-9ee3-641cd2b614b9 with Priority: HIGHEST for action port [ 874.220830] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74b3959-7779-4599-9ee3-641cd2b614b9 with Priority: HIGHEST for action port [ 874.221178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74b3959-7779-4599-9ee3-641cd2b614b9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.221301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74b3959-7779-4599-9ee3-641cd2b614b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.221373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74b3959-7779-4599-9ee3-641cd2b614b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.221654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74b3959-7779-4599-9ee3-641cd2b614b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.221746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74b3959-7779-4599-9ee3-641cd2b614b9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.424191] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.424491] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.424682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.424904] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.425115] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.425253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 419393b2-9d3d-4758-b2b7-071e2efbd475 not found, creating... [ 874.425520] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.425677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.425794] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.426034] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.426173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.426452] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.426603] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.426718] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.426926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.427077] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.427462] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 419393b2-9d3d-4758-b2b7-071e2efbd475 is going to be created. [ 874.450751] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.451452] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.451452] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.451755] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.452162] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.452538] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.510528] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.724173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b74b3959-7779-4599-9ee3-641cd2b614b9 [ 874.724422] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.724562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.724632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.724843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.724939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.725571] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b74b3959-7779-4599-9ee3-641cd2b614b9 already deleted. [ 874.725571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74b3959-7779-4599-9ee3-641cd2b614b9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.821272] env[65119]: INFO networking_nsxv3.common.synchronization [req-f2c8b204-dd71-43d9-92be-081ae2cad45e req-c4d8f0e8-4bc8-4da9-b499-42e7adc4569d tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 874.822063] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 874.822312] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.822457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.822529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.822754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.822925] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.823054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.823124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.823306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.823422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.823539] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.013117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.013280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.013353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.013574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.014837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.014972] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 875.047225] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.047225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.047225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.047225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.050806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.061961] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 875.202888] env[65119]: INFO networking_nsxv3.common.synchronization [req-b777484c-02a5-44fc-b044-284e28b11389 req-f59fbb63-bd43-4dae-82d3-ccb82c40c676 service nova] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 875.203119] env[65119]: INFO networking_nsxv3.common.synchronization [req-b777484c-02a5-44fc-b044-284e28b11389 req-f59fbb63-bd43-4dae-82d3-ccb82c40c676 service nova] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 875.203270] env[65119]: INFO networking_nsxv3.common.synchronization [req-b777484c-02a5-44fc-b044-284e28b11389 req-f59fbb63-bd43-4dae-82d3-ccb82c40c676 service nova] Enqueued Resource ID: 419393b2-9d3d-4758-b2b7-071e2efbd475 with Priority: HIGHEST for action port [ 875.203806] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_rules [ 875.203934] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 875.208847] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419393b2-9d3d-4758-b2b7-071e2efbd475 with Priority: HIGHEST for action port [ 875.208847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.208847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.208847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.208847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.208847] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.209664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.209904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.209991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.210575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.210888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.211107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.211306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.211570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.211665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.211766] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.213373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-419393b2-9d3d-4758-b2b7-071e2efbd475 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.213498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.213563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.217020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.217020] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419393b2-9d3d-4758-b2b7-071e2efbd475',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.326734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.326945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.327086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.327303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.351154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.351416] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.351541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.351610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.351816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.351896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.351983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 875.388149] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.388316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.388389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.388600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.390076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.399074] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 875.715716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.717182] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.717780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.717780] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 419393b2-9d3d-4758-b2b7-071e2efbd475 with status ACTIVE [ 875.717895] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.717998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.718096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.718414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.718414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.718655] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.718855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.718948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.719281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.719402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.719706] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.719865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.719958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.720224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.720381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.720536] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 419393b2-9d3d-4758-b2b7-071e2efbd475 is going to be updated. [ 875.745890] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.746148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.746435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.746435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.746581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.746785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419393b2-9d3d-4758-b2b7-071e2efbd475" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.025178] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8565951c-cbae-4eb6-819b-3242d94d1089 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 876.025564] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 876.026685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.027183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.027183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.027371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.027371] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.177893] env[65119]: INFO networking_nsxv3.common.synchronization [None req-66ebecb7-538b-4596-b26b-a1afaf938311 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 876.178403] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 876.178703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.178853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.222827] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.552963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.552963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.552963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.553219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.553276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.553696] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece already deleted. [ 876.553696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.553696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.554060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.554154] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.715059] env[65119]: INFO networking_nsxv3.common.synchronization [None req-d2e30bde-8cdb-4317-a8a0-02bcc68b6f48 None None] Enqueued Resource ID: 7a191f49-fe89-4f99-8b50-d3bdc00a4d90 with Priority: HIGHEST for action port [ 876.715323] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a191f49-fe89-4f99-8b50-d3bdc00a4d90 with Priority: HIGHEST for action port [ 876.715609] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a191f49-fe89-4f99-8b50-d3bdc00a4d90 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.715773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a191f49-fe89-4f99-8b50-d3bdc00a4d90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.716065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a191f49-fe89-4f99-8b50-d3bdc00a4d90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.716241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a191f49-fe89-4f99-8b50-d3bdc00a4d90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.716350] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a191f49-fe89-4f99-8b50-d3bdc00a4d90',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.726039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.726301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.726416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.726774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.726924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.727080] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568eca14-d302-4960-af0c-9198176e727f is going to be created. [ 876.757456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.757865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.757987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.758248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.758428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.774135] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: UNINITIALIZED for 2s [ 877.076936] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 877.077266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.077751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.077959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.078399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.078726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.078860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.079152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.079328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.079480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.079744] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.082155] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.082260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.082395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.082595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.082941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.082941] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece already deleted. [ 877.083107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.216984] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-9904b350-ed0e-4ab0-afca-c55255c2db90 tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 877.217603] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 877.218143] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.218297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.218364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.218581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.218792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.218987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.219068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.219651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.219651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.219651] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.221546] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a191f49-fe89-4f99-8b50-d3bdc00a4d90 [ 877.221750] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.221864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.221933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.222269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.222364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.222481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a191f49-fe89-4f99-8b50-d3bdc00a4d90 already deleted. [ 877.222536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a191f49-fe89-4f99-8b50-d3bdc00a4d90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.412615] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 877.413238] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e deletion is rescheduled due to dependency. [ 877.413238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.584909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.585086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.585200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.585563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.586490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.586701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.586841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.587183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.587349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.587520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.587919] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.588298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.588298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.588298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.588451] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.588907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.588987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.589176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.589260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.589341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.589824] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.635173] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-17030008-dfbf-4819-acb1-c8c5bf80932e tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 877.635968] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 877.636104] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.636236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.723421] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.723696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.723696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.724435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.745805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.746308] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.748022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.748022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.748022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.748022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.748022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 877.778208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.778208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.778208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.778208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.778208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.788599] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 877.992403] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.992617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-563" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.992724] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-563" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.993087] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-563" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.993375] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.993533] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.993651] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.993887] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.994045] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.994269] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.994399] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.994577] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.994708] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.994832] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.995050] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.995110] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.015143] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.015332] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.015477] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.015622] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-563" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.015944] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-95470af9-a965-4ad5-aedd-83907ab8d33b taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.016134] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.016254] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.016590] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.016759] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95470af9-a965-4ad5-aedd-83907ab8d33b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.093069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a32e7cc-5871-4cac-93b4-13eb1e04d001: rpc.has_security_group_logging(os_id): False [ 878.127169] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.127409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.127500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.127727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.158712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.159208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.159292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.159292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.159569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.159697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.159931] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.160075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.160145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.160310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.160388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.160685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.160794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.160942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.161363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.161363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.161363] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 878.232321] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.232555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.232555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.232757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.232962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.252545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 878.519663] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.519992] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.520120] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.520438] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.520598] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.520761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 95470af9-a965-4ad5-aedd-83907ab8d33b not found, creating... [ 878.521177] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.521327] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.521453] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.521710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.521856] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.522191] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.522353] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.522485] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.522716] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.522856] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.523026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 95470af9-a965-4ad5-aedd-83907ab8d33b is going to be created. [ 878.550071] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.550236] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.550291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.550647] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.551038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.551223] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.788138] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: SUCCESS [ 878.788477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.788585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.788879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.789111] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.789235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.789302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.789463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.789538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.789621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.789712] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.262948] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-1f74773c-e8ff-47eb-bc2b-51d284731689 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 879.263164] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-1f74773c-e8ff-47eb-bc2b-51d284731689 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 879.263324] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-1f74773c-e8ff-47eb-bc2b-51d284731689 service nova] Enqueued Resource ID: 95470af9-a965-4ad5-aedd-83907ab8d33b with Priority: HIGHEST for action port [ 879.263878] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 879.264025] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 879.264130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95470af9-a965-4ad5-aedd-83907ab8d33b with Priority: HIGHEST for action port [ 879.264445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.264572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.264639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.264935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.264935] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.267795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.267943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.268164] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-95470af9-a965-4ad5-aedd-83907ab8d33b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.268487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.268487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.268647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.268717] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95470af9-a965-4ad5-aedd-83907ab8d33b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.293438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.768763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.768976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.771060] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95470af9-a965-4ad5-aedd-83907ab8d33b with status ACTIVE [ 879.771060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.771060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.771060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.771298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.771298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.771467] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.771572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.771805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.771805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.771878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.772397] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.772397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.772397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.772397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.772397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.772592] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95470af9-a965-4ad5-aedd-83907ab8d33b is going to be updated. [ 879.798464] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 568eca14-d302-4960-af0c-9198176e727f: rpc.has_security_group_logging(os_id): False [ 879.801362] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 4s [ 879.807196] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.807300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.807390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.807570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.807702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.807858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95470af9-a965-4ad5-aedd-83907ab8d33b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.819424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.819621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.819901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.820113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.820113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.820320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.820434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.820500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.820671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.820748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.820838] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568eca14-d302-4960-af0c-9198176e727f is going to be created. [ 879.914918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.915115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.915216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.915868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.916520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.918316] env[65119]: INFO networking_nsxv3.common.synchronization [req-486254f9-3aea-4457-a75e-38ce169a05be req-96f37dec-00cb-44c2-a978-653f5c76177d tempest-ServerAddressesNegativeTestJSON-1960043447 tempest-ServerAddressesNegativeTestJSON-1960043447-project-member] Enqueued Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 879.919135] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 879.920112] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.920306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.920432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.920748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.921066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.921350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.921462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.921701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.921837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.922072] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.941037] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: IN_PROGRESS for 2s [ 880.247932] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.248149] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-136" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.248258] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-136" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.248641] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-136" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.248982] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.249187] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.249305] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.249535] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.249677] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.249939] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.250091] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.250237] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.250373] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.250491] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.250596] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.250731] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.282219] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 880.282444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.283506] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.283688] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.283830] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.284020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-136" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.284433] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-aae78311-f011-443b-8998-f0ffee80cbca taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.284631] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.284758] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.285095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.285307] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae78311-f011-443b-8998-f0ffee80cbca',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.425490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.425490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.425490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.425814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.425912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.426131] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.426248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.426314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.426607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.426607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.426702] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 already deleted. [ 880.426743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.433489] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.433852] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-594" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.434109] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-594" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.434574] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-594" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.435073] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.435356] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.435583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.435988] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.436248] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.436613] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.436878] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.437118] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.437326] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.437524] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.437739] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.437978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.461448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.461819] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.461819] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.462666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-594" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.462666] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-03292db5-6bd8-4ddc-a546-1674b4bf4403 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.462666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.462666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.464080] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.464080] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03292db5-6bd8-4ddc-a546-1674b4bf4403',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.788234] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.788361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.788751] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.788874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.789031] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.789212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port aae78311-f011-443b-8998-f0ffee80cbca not found, creating... [ 880.789495] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.789674] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.789846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.790144] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.790306] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.790624] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.790783] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.790913] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.791247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.791319] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.791476] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: aae78311-f011-443b-8998-f0ffee80cbca is going to be created. [ 880.813816] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.814261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.814261] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.814575] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.814880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.815159] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.966479] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.967032] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.967287] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.967636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.967821] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.968049] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 03292db5-6bd8-4ddc-a546-1674b4bf4403 not found, creating... [ 880.968386] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.968596] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.968750] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.969125] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.969301] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.969734] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.970019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.970226] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.970502] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.970671] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.970849] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 03292db5-6bd8-4ddc-a546-1674b4bf4403 is going to be created. [ 881.000169] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.000527] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.004307] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.004307] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.004307] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.004307] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.536052] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-f6edad73-c9dc-4cee-9766-f21c2ff368e6 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 881.536052] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-f6edad73-c9dc-4cee-9766-f21c2ff368e6 service nova] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 881.536052] env[65119]: INFO networking_nsxv3.common.synchronization [req-131e45a2-0ffa-4276-a71d-757195655cfb req-f6edad73-c9dc-4cee-9766-f21c2ff368e6 service nova] Enqueued Resource ID: aae78311-f011-443b-8998-f0ffee80cbca with Priority: HIGHEST for action port [ 881.536297] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_rules [ 881.536558] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 881.536899] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae78311-f011-443b-8998-f0ffee80cbca with Priority: HIGHEST for action port [ 881.537305] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.537531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.538662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.538662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.538662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-aae78311-f011-443b-8998-f0ffee80cbca taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.538662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.538662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.538887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.538951] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae78311-f011-443b-8998-f0ffee80cbca',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.699183] env[65119]: INFO networking_nsxv3.common.synchronization [req-486254f9-3aea-4457-a75e-38ce169a05be req-a4a38a8e-4dd0-4eee-a9d6-fe6e5703054d service nova] Enqueued Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_rules [ 881.699183] env[65119]: INFO networking_nsxv3.common.synchronization [req-486254f9-3aea-4457-a75e-38ce169a05be req-a4a38a8e-4dd0-4eee-a9d6-fe6e5703054d service nova] Enqueued Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 881.699364] env[65119]: INFO networking_nsxv3.common.synchronization [req-486254f9-3aea-4457-a75e-38ce169a05be req-a4a38a8e-4dd0-4eee-a9d6-fe6e5703054d service nova] Enqueued Resource ID: 03292db5-6bd8-4ddc-a546-1674b4bf4403 with Priority: HIGHEST for action port [ 881.700027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_rules [ 881.700027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 881.700027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03292db5-6bd8-4ddc-a546-1674b4bf4403 with Priority: HIGHEST for action port [ 881.701063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.701250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.701349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.701621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.701707] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.702726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.702798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.702856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.703036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.703187] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.703287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.703364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.703506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.703593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.703681] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.704733] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-03292db5-6bd8-4ddc-a546-1674b4bf4403 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.704880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.704951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.705270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.705270] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03292db5-6bd8-4ddc-a546-1674b4bf4403',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.817879] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 881.817879] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 deletion is rescheduled due to dependency. [ 881.817879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.817879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.817879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.818377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.818377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.818377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.818570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.818619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.818717] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.968781] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: SUCCESS [ 881.968781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.983626] env[65119]: INFO networking_nsxv3.common.synchronization [req-02c26cbf-a973-4522-b42a-65998b953742 req-d4dfc44a-4541-426b-839c-5ad48637c0db tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 881.986032] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 881.987469] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.990193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.990193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.990193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.990193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.990193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.990193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.991343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.991966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.995120] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.046214] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aae78311-f011-443b-8998-f0ffee80cbca with status ACTIVE [ 882.046536] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.046713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.046908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.047469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.047659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.047823] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.048034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.048034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.048425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.048553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.048793] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.049054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.049209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.049398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.049485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.049578] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aae78311-f011-443b-8998-f0ffee80cbca is going to be updated. [ 882.084644] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.084644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.084644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.084644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.084644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.084644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aae78311-f011-443b-8998-f0ffee80cbca" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.208287] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.208287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.208287] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.209621] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03292db5-6bd8-4ddc-a546-1674b4bf4403 with status ACTIVE [ 882.209795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.210096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.210096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.210383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.210572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.210792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.210997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.211117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.211306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.211390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.211589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.211711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.211762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.212082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.212207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.212429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03292db5-6bd8-4ddc-a546-1674b4bf4403 is going to be updated. [ 882.241553] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.241791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.241890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.242527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.242527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.242682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03292db5-6bd8-4ddc-a546-1674b4bf4403" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.325918] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.496920] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.710528] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.828069] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.999230] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.214703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.214923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.215017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.215266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.215360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.215461] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 is going to be created. [ 883.247585] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.247740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.247795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.248022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.248198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.262894] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: UNINITIALIZED for 2s [ 883.333670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.333849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.333912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.334856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.334856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.334856] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 883.368463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.368622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.368669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.368899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.369073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.384663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 883.504592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.504843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.504942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.505301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.505450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.505601] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 883.586622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.586936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.586936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.587235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.587423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.606060] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 883.704825] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b5df9ef-b709-497b-bbad-81495709f28b req-88b07369-9fb5-431c-bded-12008c76a83f tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 883.705501] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 883.705774] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.705903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.705976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.708729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.708812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.708939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.709026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.709229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.709329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.709438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.200595] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.201587] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.201909] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.202450] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.203706] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.203706] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.203706] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.204086] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.204086] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.204456] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.204645] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.205048] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.205048] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.205821] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.206087] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.206448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.212476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.212769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.212925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.213350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.215023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.215556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.215815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.215980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.216375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.216577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.216789] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d already deleted. [ 884.216934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.230692] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.231024] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.231528] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.231687] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.232429] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-d7602271-1e20-4094-ad45-104543839a59 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.233514] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.233514] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.233822] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.234060] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7602271-1e20-4094-ad45-104543839a59',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.422625] env[65119]: INFO networking_nsxv3.common.synchronization [None req-16b76947-c6f4-41e3-a371-6b2f364d9262 None None] Enqueued Resource ID: 44bf7201-e919-403b-a316-8dee4e66aa44 with Priority: HIGHEST for action port [ 884.423497] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bf7201-e919-403b-a316-8dee4e66aa44 with Priority: HIGHEST for action port [ 884.424020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-44bf7201-e919-403b-a316-8dee4e66aa44 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.424242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44bf7201-e919-403b-a316-8dee4e66aa44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.424379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44bf7201-e919-403b-a316-8dee4e66aa44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.424707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44bf7201-e919-403b-a316-8dee4e66aa44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.424838] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44bf7201-e919-403b-a316-8dee4e66aa44',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.736748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.737124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.737333] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.737957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.738191] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.738410] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port d7602271-1e20-4094-ad45-104543839a59 not found, creating... [ 884.738745] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.738983] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.739174] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.739486] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.739683] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.740152] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.740396] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.740591] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.740863] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.741065] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.741272] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: d7602271-1e20-4094-ad45-104543839a59 is going to be created. [ 884.770836] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.771211] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.771418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.771705] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.771937] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.772255] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.930236] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44bf7201-e919-403b-a316-8dee4e66aa44 [ 884.930885] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.930885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.930885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.931130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.931165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.931346] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44bf7201-e919-403b-a316-8dee4e66aa44 already deleted. [ 884.931346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44bf7201-e919-403b-a316-8dee4e66aa44" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.274215] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: SUCCESS [ 885.274414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.274579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.274796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.274995] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.275139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.275203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.275351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.275433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.275519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.275611] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.401802] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 885.402674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.402674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.402938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.402971] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.403203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.403247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.403422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.403532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.403664] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.622417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 885.622417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.646429] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b5df9ef-b709-497b-bbad-81495709f28b req-6a4957c8-9a05-4579-b30e-bb001ec0f788 service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 885.646429] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b5df9ef-b709-497b-bbad-81495709f28b req-6a4957c8-9a05-4579-b30e-bb001ec0f788 service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 885.646429] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b5df9ef-b709-497b-bbad-81495709f28b req-6a4957c8-9a05-4579-b30e-bb001ec0f788 service nova] Enqueued Resource ID: d7602271-1e20-4094-ad45-104543839a59 with Priority: HIGHEST for action port [ 885.646991] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 885.647374] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 885.648344] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7602271-1e20-4094-ad45-104543839a59 with Priority: HIGHEST for action port [ 885.651021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.651021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.651021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.651021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.651021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.652663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.652928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.653088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.653362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.653604] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.654098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.654242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.654549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.654726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.654894] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.656173] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7602271-1e20-4094-ad45-104543839a59 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.656476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.656645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.656882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.657050] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7602271-1e20-4094-ad45-104543839a59',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.779241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.779441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.779502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.779707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.779868] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.779988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.780067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.780271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.780336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.780693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.780693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.780867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.780867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.781018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.781195] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.781284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.781284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.781438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.781615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.781615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.781720] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.913965] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.159510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.159677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.160656] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.161145] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7602271-1e20-4094-ad45-104543839a59 with status ACTIVE [ 886.161438] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.161631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.161724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.161954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.163657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.163657] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.163657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.163657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.163657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.163657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.164439] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.164439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.166774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.166774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.166774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.166774] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7602271-1e20-4094-ad45-104543839a59 is going to be updated. [ 886.197356] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.197598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.197716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.198143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.198342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.198557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7602271-1e20-4094-ad45-104543839a59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.287031] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72a5ebce-3df0-4dab-b5cb-7ec6881e7385: rpc.has_security_group_logging(os_id): False [ 886.314925] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.314925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.314925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.314925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.314925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.315697] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.315697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.315697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.315697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.315697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.315697] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.315951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.315951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.316098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.317999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.318377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.318521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.318565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.318858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.318858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.319016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 is going to be created. [ 886.389436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.389666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.389722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.390031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.390272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.404348] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: IN_PROGRESS for 2s [ 886.416065] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.675626] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.919448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.919642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.919642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.920601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.920601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.920601] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 886.978342] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.978566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.978566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.978771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.979055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.993168] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 887.181726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.181914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.181991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.182565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.182565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.182565] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be created. [ 887.209607] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.209792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.209827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.210064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.210237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.224077] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: UNINITIALIZED for 2s [ 887.656573] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e0bbca4b-773c-4345-953b-302d2dd0482b None None] Enqueued Resource ID: 61a679e5-a71c-437c-833d-eaeae3edcf4b with Priority: HIGHEST for action port [ 887.657224] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a679e5-a71c-437c-833d-eaeae3edcf4b with Priority: HIGHEST for action port [ 887.657540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a679e5-a71c-437c-833d-eaeae3edcf4b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.657664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a679e5-a71c-437c-833d-eaeae3edcf4b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.657729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a679e5-a71c-437c-833d-eaeae3edcf4b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.657992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a679e5-a71c-437c-833d-eaeae3edcf4b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.659314] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a679e5-a71c-437c-833d-eaeae3edcf4b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.162363] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61a679e5-a71c-437c-833d-eaeae3edcf4b [ 888.162363] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.162363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.162363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.162363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.162363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.162363] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61a679e5-a71c-437c-833d-eaeae3edcf4b already deleted. [ 888.162363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a679e5-a71c-437c-833d-eaeae3edcf4b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.421263] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: SUCCESS [ 888.421263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.007070] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 889.007427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.007569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.007850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.008187] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.008327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.008395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.008604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.008865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.009321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.009458] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.010423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.010606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.011035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.011169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.011274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.011457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.011543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.011660] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.235451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 889.236192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.236192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.236192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.236379] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.236491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.236540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.236691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.236798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.236930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.237127] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.515319] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.515319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.515319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.744058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.744058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.744058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.744058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.744976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.744976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.744976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.744976] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.018977] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.248821] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a698aa11-3871-4c02-b0a5-985be0e71f6d: rpc.has_security_group_logging(os_id): False [ 890.270186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.270186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.270186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.270186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.270653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.270653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.270653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.270653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.270653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.270653] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be created. [ 890.352150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.352150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.352378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.353027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.353027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.378772] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 890.522413] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.522500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.522532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.522876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.522876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.522996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 890.560482] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.560559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.560588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.560855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.561023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.571207] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 890.982932] env[65119]: INFO networking_nsxv3.common.synchronization [req-3db95a8a-ab27-4973-b00a-0f2b57afeb86 req-fff52bc9-37a3-4a1d-8dc0-027613a9223c tempest-ServersTestJSON-1698246118 tempest-ServersTestJSON-1698246118-project-member] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 890.983593] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGHEST for action security_group_members [ 890.984135] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.984306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.984429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.984691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.984945] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.985269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.985269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.985652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.985652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.985858] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.325632] env[65119]: INFO networking_nsxv3.common.synchronization [req-cf7c3383-4cbb-4b92-8149-326e0045cfa5 req-79e0da74-e8ab-496f-ac37-79d6c1cafc45 tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 891.326596] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 891.326952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.329859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.330028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.330209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.330389] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.330499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.330566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.330725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.330805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.330903] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.490510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.490510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.490510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.490740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.514232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.514572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.514707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.514707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.514947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.515046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.515137] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 is going to be updated. [ 891.551645] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.551645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.551645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.551645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.551645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.562798] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: IN_PROGRESS for 2s [ 891.837263] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.343398] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.396106] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 892.396379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.585715] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 892.585950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.586067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.586302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.586493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.587456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.587456] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.588111] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.588111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.588111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.588111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.588111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.588340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.588340] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.845642] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.845642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.845878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.845980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.846051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.846181] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 892.885396] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.885647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.885718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.885946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.886151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.903067] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 893.093478] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d044d815-6af5-4fd9-a0b1-bc64182a7697: rpc.has_security_group_logging(os_id): False [ 893.119190] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.119190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.119190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.119190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.119190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.119190] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.119494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.119494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.119494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.119629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.123283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.123283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.123283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.123283] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 893.233650] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.233836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.234012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.234331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.234331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.253607] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 893.609589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed152bbd-2522-4d15-9d17-a181bc283606 in Status: SUCCESS [ 893.609974] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 deletion is rescheduled due to dependency. [ 893.609974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.981641] env[65119]: INFO networking_nsxv3.common.synchronization [req-7de5b141-95e8-416b-a019-f4fb53b0fd69 req-b653d1dd-9fa0-485c-86f4-a0b508542449 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 893.982202] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 893.982513] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.982637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.982707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.982909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.984053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.984169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.984276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.984427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.984516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.984616] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.488388] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.914297] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 894.914636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.928590] env[65119]: INFO networking_nsxv3.common.synchronization [req-810e141e-72c5-42c3-8309-70c369e7b1b6 req-5884905d-6ad9-4391-9c98-26a62a0618eb tempest-ServerAddressesNegativeTestJSON-1960043447 tempest-ServerAddressesNegativeTestJSON-1960043447-project-member] Enqueued Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 894.929316] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGHEST for action security_group_members [ 894.929498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.929617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.929683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.929881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.930122] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.930265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.930308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.930446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.930528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.930622] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.992049] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.270668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 895.270668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.270668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.270668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.270668] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.434125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.434391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.434391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.434592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.434658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.434852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.434951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.435028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.435183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.435255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.435481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 is going to be updated. [ 895.440232] env[65119]: INFO networking_nsxv3.common.synchronization [req-fd95eb66-fcf7-4b79-82bb-d3e4271ef0f1 req-5664988e-270e-45bb-8e28-9a150686401a tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 895.442807] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 895.443205] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.443650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.443650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.443650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.443771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.443823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.443873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.444668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.444847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.444986] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.471336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.471524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.471580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.471776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.471936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.482850] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: IN_PROGRESS for 2s [ 895.496047] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.496334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.496480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.497017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.497017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.497017] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 895.536104] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.536407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.536471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.536794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.537040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.547612] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 895.775308] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.775516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.775592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.775851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.775985] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.776102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.776189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.776316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.776404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.776493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.776582] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.831266] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.831465] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.831465] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.831858] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.832482] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.832824] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.832911] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.833164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.833341] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.833585] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.833768] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.834014] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.834079] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.834152] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.834264] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.834400] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.880095] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.880095] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.880095] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.880095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.880095] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-6df6aa78-2eff-40c4-8e19-1fcb21db5679 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.880095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.880095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.880095] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.880095] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df6aa78-2eff-40c4-8e19-1fcb21db5679',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.948534] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.948892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.948892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.949064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.949176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.950644] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.951018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.951155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.951447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.951599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.951761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 895.988551] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.988743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.988786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.989131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.989309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.003395] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 896.033680] env[65119]: INFO networking_nsxv3.common.synchronization [None req-6b7c1ab5-9961-414a-95e2-c91e33cc9da1 None None] Enqueued Resource ID: 571610c0-84ce-463d-bee2-05be7541dd59 with Priority: HIGHEST for action port [ 896.033975] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 571610c0-84ce-463d-bee2-05be7541dd59 with Priority: HIGHEST for action port [ 896.034900] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-571610c0-84ce-463d-bee2-05be7541dd59 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.035097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-571610c0-84ce-463d-bee2-05be7541dd59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.035185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-571610c0-84ce-463d-bee2-05be7541dd59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.035491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-571610c0-84ce-463d-bee2-05be7541dd59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.035805] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571610c0-84ce-463d-bee2-05be7541dd59',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.279619] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.279805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.279859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.280127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.280315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.280433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.280502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.280667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.280761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.280855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.281031] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.281138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.281238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.281403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.281582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.281683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.281748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.281894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.281979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.282090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.282191] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.384689] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.384689] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.384948] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.385443] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.385443] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.385443] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 6df6aa78-2eff-40c4-8e19-1fcb21db5679 not found, creating... [ 896.385626] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.385792] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.386483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.386483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.386483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.386639] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.386722] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.386844] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.387110] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.387259] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.387403] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 6df6aa78-2eff-40c4-8e19-1fcb21db5679 is going to be created. [ 896.413808] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.414066] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.414183] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.414483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.415120] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.415120] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.538610] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 571610c0-84ce-463d-bee2-05be7541dd59 [ 896.538807] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.538947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.539111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.539337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.539436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.539518] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:571610c0-84ce-463d-bee2-05be7541dd59 already deleted. [ 896.539598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-571610c0-84ce-463d-bee2-05be7541dd59" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.788380] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d044d815-6af5-4fd9-a0b1-bc64182a7697: rpc.has_security_group_logging(os_id): False [ 896.816935] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.816935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.816935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.817259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.817383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.817552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.817694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.818310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.818310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.818310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.818310] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.818497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.818497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.818585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.818629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.818915] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.818915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.819069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.819212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.819304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.819304] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 896.931923] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.932724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.932724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.932724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.932724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.970628] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 897.137316] env[65119]: INFO networking_nsxv3.common.synchronization [req-fd95eb66-fcf7-4b79-82bb-d3e4271ef0f1 req-dc6d6243-53b0-4547-a2f8-b8a94c0a3f38 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 897.137316] env[65119]: INFO networking_nsxv3.common.synchronization [req-fd95eb66-fcf7-4b79-82bb-d3e4271ef0f1 req-dc6d6243-53b0-4547-a2f8-b8a94c0a3f38 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 897.137316] env[65119]: INFO networking_nsxv3.common.synchronization [req-fd95eb66-fcf7-4b79-82bb-d3e4271ef0f1 req-dc6d6243-53b0-4547-a2f8-b8a94c0a3f38 service nova] Enqueued Resource ID: 6df6aa78-2eff-40c4-8e19-1fcb21db5679 with Priority: HIGHEST for action port [ 897.137860] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 897.137913] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 897.138397] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df6aa78-2eff-40c4-8e19-1fcb21db5679 with Priority: HIGHEST for action port [ 897.138397] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.138706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.138706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.138706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.138890] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.139812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.139812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.140039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df6aa78-2eff-40c4-8e19-1fcb21db5679 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.140161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.140248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.144284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.144284] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df6aa78-2eff-40c4-8e19-1fcb21db5679',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.499487] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 in Status: SUCCESS [ 897.499487] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 deletion is rescheduled due to dependency. [ 897.499487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.558689] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 897.558689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.620898] env[65119]: INFO networking_nsxv3.common.synchronization [req-c6b0e480-9580-4560-8369-5b2722b98447 req-fac1a6ad-0a78-4704-af74-9fe6901d31b6 tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 897.621638] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 897.622105] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.624206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.624206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.624206] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.648022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.648022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6df6aa78-2eff-40c4-8e19-1fcb21db5679 with status ACTIVE [ 897.648022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.648022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.648705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.648705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.648705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.648705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648705] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6df6aa78-2eff-40c4-8e19-1fcb21db5679 is going to be updated. [ 897.677905] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.678063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.678134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.678338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.678468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.678620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df6aa78-2eff-40c4-8e19-1fcb21db5679" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.945697] env[65119]: INFO networking_nsxv3.common.synchronization [req-c6b0e480-9580-4560-8369-5b2722b98447 req-900da787-e30a-4a48-bd66-c8baae44eb1c tempest-ServersTestMultiNic-878550190 tempest-ServersTestMultiNic-878550190-project-member] Enqueued Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 897.948121] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 with Priority: HIGHEST for action security_group_members [ 897.949916] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d044d815-6af5-4fd9-a0b1-bc64182a7697 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.949916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.015661] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 898.015661] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 898.015661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.016119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.016119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.016119] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.016223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.016355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.016529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.016608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.016724] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.126425] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.135344] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7e7bcb91-d0aa-4ec1-8768-08e78484d4bc tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 898.135344] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 898.135344] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.135344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.135344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.135976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.137390] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.253317] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ae72a058-39d9-44ca-8629-9f495579b2c2 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 898.253317] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 898.253489] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.253692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.423395] env[65119]: INFO networking_nsxv3.common.synchronization [None req-f22133dc-04b1-4572-bb49-1f7d0576f4d9 None None] Enqueued Resource ID: fe2383a2-50d4-42b0-80d4-6a940b5ed934 with Priority: HIGHEST for action port [ 898.423667] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2383a2-50d4-42b0-80d4-6a940b5ed934 with Priority: HIGHEST for action port [ 898.424531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe2383a2-50d4-42b0-80d4-6a940b5ed934 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.424938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe2383a2-50d4-42b0-80d4-6a940b5ed934" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.425803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe2383a2-50d4-42b0-80d4-6a940b5ed934" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.426525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe2383a2-50d4-42b0-80d4-6a940b5ed934" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.426525] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2383a2-50d4-42b0-80d4-6a940b5ed934',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.519165] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.630415] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.662601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.662768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.662824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.663043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.663131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.663225] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 already deleted. [ 898.663305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.663741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.663972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.664105] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.930057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe2383a2-50d4-42b0-80d4-6a940b5ed934 [ 898.930057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.930274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.930274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.930599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.930599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.930599] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe2383a2-50d4-42b0-80d4-6a940b5ed934 already deleted. [ 898.931312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe2383a2-50d4-42b0-80d4-6a940b5ed934" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.987773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 898.987773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.022065] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.137027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.137027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.137027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.137027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.137027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.137027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 899.165017] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.165254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.165319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.165525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.165689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.179326] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 899.190341] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.190556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.190556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.190858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.190938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.191015] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 already deleted. [ 899.191166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.524685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.524966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.525638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.525638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.525748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.525858] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 899.567555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.567768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.567843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.568084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.568225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.578220] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 900.124306] env[65119]: INFO networking_nsxv3.common.synchronization [req-abef469c-cc40-4dc1-a7bd-a578557aec77 req-82104ca5-632e-4d3b-8ec8-8e07a822c9a4 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 900.126028] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 900.126028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.126028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.126028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.126028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.126028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.126334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.126334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.126401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.126508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.128232] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.545361] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.545635] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.545774] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.546117] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.546387] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.546543] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.546659] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.547264] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.547539] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.548722] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.549019] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.549994] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.550162] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.550307] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.550812] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.550975] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.571852] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.572059] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.572227] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.572548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.572793] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-af638d68-3b8a-4127-9105-3865657331c4 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.572969] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.573117] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.573483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.573638] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af638d68-3b8a-4127-9105-3865657331c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.629923] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.629923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.629923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.630216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.630216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.630432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.630568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.630621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.630756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.630831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.630915] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece already deleted. [ 900.630994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.075921] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.076182] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.076314] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.076581] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.076730] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.076907] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port af638d68-3b8a-4127-9105-3865657331c4 not found, creating... [ 901.077170] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.077329] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.077447] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.077672] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.077797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.078084] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.078241] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.078360] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.078664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.078738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.078822] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: af638d68-3b8a-4127-9105-3865657331c4 is going to be created. [ 901.099370] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.099579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.099702] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.099976] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.100229] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.100450] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.202551] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 901.202907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.202943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.203276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.203506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.203652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.203742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.203927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.204057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.204158] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d044d815-6af5-4fd9-a0b1-bc64182a7697',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.362999] env[65119]: INFO networking_nsxv3.common.synchronization [None req-25b92a5e-ef60-41e9-ae54-b4cfcca61251 None None] Enqueued Resource ID: e206e7d4-1199-4e09-8dd3-239b134665cd with Priority: HIGHEST for action port [ 901.363552] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e206e7d4-1199-4e09-8dd3-239b134665cd with Priority: HIGHEST for action port [ 901.364301] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e206e7d4-1199-4e09-8dd3-239b134665cd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.364445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e206e7d4-1199-4e09-8dd3-239b134665cd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.364660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e206e7d4-1199-4e09-8dd3-239b134665cd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.364781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e206e7d4-1199-4e09-8dd3-239b134665cd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.364871] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e206e7d4-1199-4e09-8dd3-239b134665cd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.593756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.593756] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.593756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.593756] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.709842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.709842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.709842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.709842] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 is going to be updated. [ 901.748420] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.748420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.748420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.748633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.748919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.772532] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: IN_PROGRESS for 2s [ 901.866698] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e206e7d4-1199-4e09-8dd3-239b134665cd [ 901.867037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.870038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.870038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.870038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.870038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.870038] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e206e7d4-1199-4e09-8dd3-239b134665cd already deleted. [ 901.870038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e206e7d4-1199-4e09-8dd3-239b134665cd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.874170] env[65119]: INFO networking_nsxv3.common.synchronization [req-abef469c-cc40-4dc1-a7bd-a578557aec77 req-33e4253c-63ff-42b3-97ea-9cdfaef3a470 service nova] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 901.874341] env[65119]: INFO networking_nsxv3.common.synchronization [req-abef469c-cc40-4dc1-a7bd-a578557aec77 req-33e4253c-63ff-42b3-97ea-9cdfaef3a470 service nova] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 901.874505] env[65119]: INFO networking_nsxv3.common.synchronization [req-abef469c-cc40-4dc1-a7bd-a578557aec77 req-33e4253c-63ff-42b3-97ea-9cdfaef3a470 service nova] Enqueued Resource ID: af638d68-3b8a-4127-9105-3865657331c4 with Priority: HIGHEST for action port [ 901.874706] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_rules [ 901.874836] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 901.874929] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af638d68-3b8a-4127-9105-3865657331c4 with Priority: HIGHEST for action port [ 901.875547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.875683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.875722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.875935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.875999] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.879471] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.879471] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.879471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.879800] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.880508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-af638d68-3b8a-4127-9105-3865657331c4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.880610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.880676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.881907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.881907] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af638d68-3b8a-4127-9105-3865657331c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.099803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.099952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.100159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.100405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.100564] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.100665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.100730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.100890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.100975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.101078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.101228] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.101322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.101397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.101543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.101724] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.101867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.101910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.102030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.102107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.102190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.102437] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.383869] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.383869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.383869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.384686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af638d68-3b8a-4127-9105-3865657331c4 with status ACTIVE [ 902.385838] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.385838] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.385838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.388673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.389236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.389236] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.389394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.389701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.389778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.389898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.390190] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af638d68-3b8a-4127-9105-3865657331c4 is going to be updated. [ 902.418916] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.419234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.419234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.419680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.419680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.419785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af638d68-3b8a-4127-9105-3865657331c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.510504] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-3ba53440-e6c3-4457-afaf-607249e90d4e tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 902.510862] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 902.511285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.511430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.511550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.511735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.511930] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.512048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.512159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.512363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.512568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.512568] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.604957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 902.627288] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.627521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.627612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.627887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.627938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.628366] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.628477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.628562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.628741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.628826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.629047] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.629179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.629248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.629399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.629475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.629696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.629796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.629856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.630253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.630253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.630253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 902.714991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.715281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.715381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.715664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.715832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.736779] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 902.892412] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.895043] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.895043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.895043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.895043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.897556] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.897770] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.897918] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.900300] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.900472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.900701] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.900820] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.900934] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.906147] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.906147] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.906147] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.906147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.927420] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.927631] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.927816] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.927988] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.928332] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-dbf6ceff-e087-4266-84ef-70b6f353bbfd taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.928524] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.928645] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.929015] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.929224] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf6ceff-e087-4266-84ef-70b6f353bbfd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.015386] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.015386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.015583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.015814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.015814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.015954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.016140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.016140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.016284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.016360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.016445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 903.047024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.047305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.047305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.047518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.048447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.062585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 903.404040] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.404323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.404323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.404487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.404581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.404678] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece is going to be created. [ 903.430519] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.430684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.430755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.430972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.431177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.432564] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.432818] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.432874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.433140] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.433292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.433444] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port dbf6ceff-e087-4266-84ef-70b6f353bbfd not found, creating... [ 903.433698] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.433855] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.433974] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.434225] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.434365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.434741] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.434808] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.437132] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.437132] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.437132] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.437132] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: dbf6ceff-e087-4266-84ef-70b6f353bbfd is going to be created. [ 903.447016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: UNINITIALIZED for 2s [ 903.458151] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.458151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.458151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.458151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.458151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.458151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.783984] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 in Status: SUCCESS [ 903.784130] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d044d815-6af5-4fd9-a0b1-bc64182a7697 deletion is rescheduled due to dependency. [ 903.784177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d044d815-6af5-4fd9-a0b1-bc64182a7697" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.280427] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-7333f2b2-41ac-4957-9c45-25da2b1251c9 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 904.280427] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-7333f2b2-41ac-4957-9c45-25da2b1251c9 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 904.280427] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-7333f2b2-41ac-4957-9c45-25da2b1251c9 service nova] Enqueued Resource ID: dbf6ceff-e087-4266-84ef-70b6f353bbfd with Priority: HIGHEST for action port [ 904.280989] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 904.281407] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 904.281679] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf6ceff-e087-4266-84ef-70b6f353bbfd with Priority: HIGHEST for action port [ 904.285073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.285073] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.285073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.285073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf6ceff-e087-4266-84ef-70b6f353bbfd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.285073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.285073] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf6ceff-e087-4266-84ef-70b6f353bbfd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.493572] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a40283f2-fb53-4d84-b64a-5e8fa1365891 None None] Enqueued Resource ID: 11a72d58-9a6b-4012-95ef-aa52d6b0f864 with Priority: HIGHEST for action port [ 904.494209] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11a72d58-9a6b-4012-95ef-aa52d6b0f864 with Priority: HIGHEST for action port [ 904.494698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-11a72d58-9a6b-4012-95ef-aa52d6b0f864 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.494869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11a72d58-9a6b-4012-95ef-aa52d6b0f864" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.494941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11a72d58-9a6b-4012-95ef-aa52d6b0f864" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.495284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11a72d58-9a6b-4012-95ef-aa52d6b0f864" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.495399] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11a72d58-9a6b-4012-95ef-aa52d6b0f864',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.751088] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 904.752688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.790023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.790023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.792771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbf6ceff-e087-4266-84ef-70b6f353bbfd with status ACTIVE [ 904.792996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.793142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.793209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.793426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.793514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.793780] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.793780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.793905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.794096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.794210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.794406] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.794511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.794774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.794774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.794774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.794895] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbf6ceff-e087-4266-84ef-70b6f353bbfd is going to be updated. [ 904.819919] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.820162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.820162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.820402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.820501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.820699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf6ceff-e087-4266-84ef-70b6f353bbfd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.000345] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11a72d58-9a6b-4012-95ef-aa52d6b0f864 [ 905.000608] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.000752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.001087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.001087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.001216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.001261] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11a72d58-9a6b-4012-95ef-aa52d6b0f864 already deleted. [ 905.001347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11a72d58-9a6b-4012-95ef-aa52d6b0f864" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.053166] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-6eda74c7-ef34-47fa-8637-22d5beaa49bd tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 905.053760] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 905.054687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.054825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.072851] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 905.073063] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 deletion is rescheduled due to dependency. [ 905.073184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.073335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.073549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.073737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.073850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.073914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.074087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.074169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.074267] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.443748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-632 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.443955] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.444096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.444939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.445915] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.445915] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.445915] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.446143] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.446209] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.446507] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.447043] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.447043] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.447043] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.447179] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.447210] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.447360] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.460521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: SUCCESS [ 905.460812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.461105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.461341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.461634] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.461787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.461894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.462180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.462317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.462457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.462611] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.471247] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.471456] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.472414] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.472520] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-632" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.472793] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-acb9fc1a-9407-4613-97d1-7bdc1164638f taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.472978] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.473116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.473449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.473610] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb9fc1a-9407-4613-97d1-7bdc1164638f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.578242] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.965133] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.977333] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.977557] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.977682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.977954] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.978115] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.978308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port acb9fc1a-9407-4613-97d1-7bdc1164638f not found, creating... [ 905.978559] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.978732] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.978852] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.979116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.979305] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.979663] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.979798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.979921] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.980221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.980372] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.980611] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: acb9fc1a-9407-4613-97d1-7bdc1164638f is going to be created. [ 906.003736] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.003968] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.004109] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.004409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.004636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.004867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.082721] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.467972] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1b3f1f-58a0-4338-b901-3409378a1ece: rpc.has_security_group_logging(os_id): False [ 906.491725] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.491876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.492133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.492474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.492719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.493016] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.493108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.493168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.493353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.493431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.493554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece is going to be created. [ 906.567354] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.567540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.567634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.567883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.568089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.582297] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: IN_PROGRESS for 2s [ 906.584961] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.585174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.585559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.585864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.585966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.586092] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 906.659746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.659937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.660020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.660388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.660542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.674141] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 906.841652] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-d28056ab-ecba-44f7-b13a-30db28121d18 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 906.841739] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-d28056ab-ecba-44f7-b13a-30db28121d18 service nova] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 906.841858] env[65119]: INFO networking_nsxv3.common.synchronization [req-69f132e6-e337-4e10-8778-a8a8a2c3efc0 req-d28056ab-ecba-44f7-b13a-30db28121d18 service nova] Enqueued Resource ID: acb9fc1a-9407-4613-97d1-7bdc1164638f with Priority: HIGHEST for action port [ 906.842467] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_rules [ 906.842611] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 906.842713] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb9fc1a-9407-4613-97d1-7bdc1164638f with Priority: HIGHEST for action port [ 906.843009] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.843418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.843672] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.843805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.843986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-acb9fc1a-9407-4613-97d1-7bdc1164638f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.844229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.844229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.844452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.844592] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb9fc1a-9407-4613-97d1-7bdc1164638f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.347695] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acb9fc1a-9407-4613-97d1-7bdc1164638f with status ACTIVE [ 907.348508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.348508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.348508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.349194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.349194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.349355] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.349533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.349634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.349903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.350103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.350415] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.350549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.350617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.350829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.350944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.351100] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acb9fc1a-9407-4613-97d1-7bdc1164638f is going to be updated. [ 907.380772] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.381027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.381027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.381280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.381489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.381666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acb9fc1a-9407-4613-97d1-7bdc1164638f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.597732] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: SUCCESS [ 908.598096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.690534] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 908.690756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.691108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.691460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.692096] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.692096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.692096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.692479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.692538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.692741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.692975] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.694286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.694556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.694825] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.695094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.695272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.696219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.696362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.696499] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.897898] env[65119]: INFO networking_nsxv3.common.synchronization [req-659d56e3-5718-4a96-8be5-018c782f2412 req-8ded7085-bf30-455d-816b-4797eaaa3ab7 tempest-ServerTagsTestJSON-398088808 tempest-ServerTagsTestJSON-398088808-project-member] Enqueued Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 908.898701] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 908.899130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.899285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.899357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.899667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.899832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.899949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.900048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.900286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.900419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.900527] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.049611] env[65119]: INFO networking_nsxv3.common.synchronization [req-32f8a3cd-8e8d-4935-8c5f-35211772575d req-2dfed115-c9c1-48ca-9ca9-73f7a3253095 tempest-MigrationsAdminTest-1612286876 tempest-MigrationsAdminTest-1612286876-project-member] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 909.050759] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGHEST for action security_group_members [ 909.052160] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.052366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.052476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.052774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.053055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.053237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.053307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.053486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.053590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.053699] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.198391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.198595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.198702] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.338775] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-67 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.340243] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-67" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.340517] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-67" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.340928] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-67" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.341347] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.341635] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.341826] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.342158] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.342322] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.342621] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.342786] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.343332] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.343568] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.343771] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.343966] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.344241] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.366889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.367214] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.367442] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.367648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-67" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.368132] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-2f3a2016-cb39-4c89-a276-cda81a8fcc81 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.368392] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.368608] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.369028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.369291] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f3a2016-cb39-4c89-a276-cda81a8fcc81',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.402931] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.403166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.403248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.403520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.403641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.403898] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.404043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.404128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.404346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.404430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.404545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40309f57-4f06-40c4-9838-656b00d3acea already deleted. [ 909.404653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.557849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.557849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.557849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.557849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.558143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.558177] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.558319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.560713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.560713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.560713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.560713] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be updated. [ 909.590755] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.590944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.592089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.592089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.592089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.603746] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: IN_PROGRESS for 2s [ 909.705438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.872061] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.872370] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.872509] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.872814] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.872963] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.873136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 2f3a2016-cb39-4c89-a276-cda81a8fcc81 not found, creating... [ 909.873423] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.873617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.873720] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.873959] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.874113] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.874413] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.874572] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.874688] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.874904] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.875050] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.875194] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 2f3a2016-cb39-4c89-a276-cda81a8fcc81 is going to be created. [ 909.900958] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.901285] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.901524] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.901934] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.902248] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.902492] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.101648] env[65119]: INFO networking_nsxv3.common.synchronization [req-56a092d4-3afd-4610-b2b3-2c7d8eb33bb9 req-714368ac-7d53-4a0e-946a-3dc3d063eaac tempest-ListImageFiltersTestJSON-1838690385 tempest-ListImageFiltersTestJSON-1838690385-project-member] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 910.102240] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 910.102572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.102699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.102770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.102991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.103179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.103326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.103372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.103516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.103612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.103708] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.208419] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.208592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.208678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.208942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.209014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.209221] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 910.240731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.241751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.241751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.241751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.241751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.251875] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 910.605931] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.671603] env[65119]: INFO networking_nsxv3.common.synchronization [req-659d56e3-5718-4a96-8be5-018c782f2412 req-ee48e89f-ce6d-45e6-b699-2945749e1738 service nova] Enqueued Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_rules [ 910.671748] env[65119]: INFO networking_nsxv3.common.synchronization [req-659d56e3-5718-4a96-8be5-018c782f2412 req-ee48e89f-ce6d-45e6-b699-2945749e1738 service nova] Enqueued Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 910.671898] env[65119]: INFO networking_nsxv3.common.synchronization [req-659d56e3-5718-4a96-8be5-018c782f2412 req-ee48e89f-ce6d-45e6-b699-2945749e1738 service nova] Enqueued Resource ID: 2f3a2016-cb39-4c89-a276-cda81a8fcc81 with Priority: HIGHEST for action port [ 910.672507] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_rules [ 910.672652] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 910.672782] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f3a2016-cb39-4c89-a276-cda81a8fcc81 with Priority: HIGHEST for action port [ 910.673162] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.673317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.673380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.673630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.673715] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.674631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.674753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.674825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.675015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.675510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.675510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.675510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.675510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.675705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.675705] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.676515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f3a2016-cb39-4c89-a276-cda81a8fcc81 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.676636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.676758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.676870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.676945] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f3a2016-cb39-4c89-a276-cda81a8fcc81',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.113473] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.179214] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.179382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.179559] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.180662] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f3a2016-cb39-4c89-a276-cda81a8fcc81 with status ACTIVE [ 911.180859] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.180992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.181098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.181839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.181839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.181839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.181839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.181839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.182121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.182121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.182176] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.183036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.183036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.183036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.183036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.183036] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f3a2016-cb39-4c89-a276-cda81a8fcc81 is going to be updated. [ 911.211027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.211027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.211027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.211027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.211027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.211027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f3a2016-cb39-4c89-a276-cda81a8fcc81" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.615502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ff7630-123f-4898-982a-bb6d45f72689 in Status: SUCCESS [ 911.615834] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 deletion is rescheduled due to dependency. [ 911.615834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.616200] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.616339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.616401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.616593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.616675] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.616764] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be updated. [ 911.650093] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.650277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.650364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.650591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.651273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.662604] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 911.685734] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.188768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.188768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.188768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.188768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.188768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.188768] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40309f57-4f06-40c4-9838-656b00d3acea is going to be created. [ 912.215539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.215803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.216315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.216633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.216832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.229967] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: UNINITIALIZED for 2s [ 912.262049] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 912.262868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.262868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.263066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.263763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.263763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.263763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.263763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.263763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.263972] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.767368] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.271890] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.676773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 913.676773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.779820] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.780240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.780240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.780471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.780588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.780763] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 913.829480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.831010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.831151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.831321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.831495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.843600] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 914.240598] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: SUCCESS [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.242578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.242578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.242578] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.745568] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.746656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.746782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.747092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.747964] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.747964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.748801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.748970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.749182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.750054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.750054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.750292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.752796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.755232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.755232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.755232] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.257233] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40309f57-4f06-40c4-9838-656b00d3acea: rpc.has_security_group_logging(os_id): False [ 915.279531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.280024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.280024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.280162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.280255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.280424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.280543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.281164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.281164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.281164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.281514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.281629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.283037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.283037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.283037] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40309f57-4f06-40c4-9838-656b00d3acea is going to be created. [ 915.349047] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9783f95c-f34c-4344-965d-a5a6f8c11bf8 tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 915.350117] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 915.350117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.350117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.350316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.352120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.352120] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.363625] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.363625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.363625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.363929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.364115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.382436] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: IN_PROGRESS for 2s [ 915.470901] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e96a868f-62dc-4b8e-b130-31ecadb9d802 tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 915.471722] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 915.472525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.472525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.860066] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.860066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.860066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.860066] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.860066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.861204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.861204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.861204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.861204] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.874042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.874522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.874683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.874947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.875253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.875450] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 already deleted. [ 915.875770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.876896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.877159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.877304] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.999969] env[65119]: INFO networking_nsxv3.common.synchronization [req-c54ebb88-8fff-411b-a9f0-ed4cc35012c2 req-2bb8a96d-46b0-474a-9703-3edf102a174b tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 916.001571] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 916.001571] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.001571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.001571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.001932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.002174] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.002346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.002483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.002833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.002833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.002982] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.363517] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c4bf50-a472-475c-9016-e8ba33d62ca9: rpc.has_security_group_logging(os_id): False [ 916.383299] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.383457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.383568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.384307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.384418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.384683] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.384798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.384864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.385060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.386926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.387298] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.387430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.387501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.387772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.387874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.388206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.388324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.388397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.388607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.388692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.388785] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 916.401898] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.402113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.402155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.402383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.402464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.402567] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 already deleted. [ 916.402647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.465869] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.466157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.466275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.466514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.466766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.484876] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 916.505836] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.506047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.506178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.506542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.507021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.507399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.507552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.507638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.507850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.508014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.508202] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 916.514553] env[65119]: INFO networking_nsxv3.common.synchronization [None req-be2e5584-220b-43cc-9cd0-4bfdccec9070 None None] Enqueued Resource ID: 2f526bea-e5e7-46c8-a878-36036f93e963 with Priority: HIGHEST for action port [ 916.515111] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f526bea-e5e7-46c8-a878-36036f93e963 with Priority: HIGHEST for action port [ 916.515443] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f526bea-e5e7-46c8-a878-36036f93e963 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.515807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f526bea-e5e7-46c8-a878-36036f93e963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.515969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f526bea-e5e7-46c8-a878-36036f93e963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.516246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f526bea-e5e7-46c8-a878-36036f93e963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.516381] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f526bea-e5e7-46c8-a878-36036f93e963',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.557758] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.557913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.557982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.558228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.558425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.569420] env[65119]: INFO networking_nsxv3.common.synchronization [req-08adf3bb-996c-4b5d-899d-103800efd069 req-d3406645-f457-49cc-8b92-589657d403d2 tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 916.571222] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 916.571573] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 916.572154] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.572280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.572348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.572552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.572705] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.572804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.572866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.573024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.573111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.573207] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.019430] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f526bea-e5e7-46c8-a878-36036f93e963 [ 917.019734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.019908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.019987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.020405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.022499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.022499] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f526bea-e5e7-46c8-a878-36036f93e963 already deleted. [ 917.022499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f526bea-e5e7-46c8-a878-36036f93e963" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.076461] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.400146] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: SUCCESS [ 917.400146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.583060] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.086756] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.086935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.087100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.087343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.087435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.087537] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 918.121521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.121521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.121521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.121521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.121521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.131180] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 918.505348] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 918.505348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.505669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.506825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.506825] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.590308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 918.590601] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d deletion is rescheduled due to dependency. [ 918.590817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.122097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.122097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.122097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.130967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.130967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.130967] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.635969] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.636343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.636343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.636585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.636875] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.637048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.637164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.637369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.637471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.637564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.637738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.637843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.637904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.639510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.639510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.639510] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.142524] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 920.142778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.143070] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c4bf50-a472-475c-9016-e8ba33d62ca9: rpc.has_security_group_logging(os_id): False [ 920.162682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.162933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.163199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.163627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.163627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.164732] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.165478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.165478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.165478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.165478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.167792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.167792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.167792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.168839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.169831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.169831] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 920.449723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.449894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.449969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.450204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.450415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.470709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 920.828025] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c4a935c4-b016-4c2d-a742-515734488a57 None None] Enqueued Resource ID: b69824ea-a6ae-46ba-a394-191791d93bee with Priority: HIGHEST for action port [ 920.828829] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b69824ea-a6ae-46ba-a394-191791d93bee with Priority: HIGHEST for action port [ 920.829290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b69824ea-a6ae-46ba-a394-191791d93bee taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.829540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b69824ea-a6ae-46ba-a394-191791d93bee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.829738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b69824ea-a6ae-46ba-a394-191791d93bee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.829968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b69824ea-a6ae-46ba-a394-191791d93bee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.830091] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b69824ea-a6ae-46ba-a394-191791d93bee',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.332300] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b69824ea-a6ae-46ba-a394-191791d93bee [ 921.333805] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.333805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.333805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.333805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.333805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.333805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b69824ea-a6ae-46ba-a394-191791d93bee already deleted. [ 921.333805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b69824ea-a6ae-46ba-a394-191791d93bee" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.411098] env[65119]: INFO networking_nsxv3.common.synchronization [req-6b64ea7e-ccc8-437d-851c-e506f2c0cedf req-bb2d2865-e7a6-4c81-aecd-9f6d633c1493 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 921.412022] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 921.412211] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.412477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.412548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.412851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.412987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.413120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.413184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.413380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.413485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.413581] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.565964] env[65119]: INFO networking_nsxv3.common.synchronization [None req-77fb5241-aa98-47f4-9fcd-15b8f0dbf6b1 None None] Enqueued Resource ID: cab92af9-cff5-4b89-8c84-ead28f13ea5b with Priority: HIGHEST for action port [ 921.567342] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab92af9-cff5-4b89-8c84-ead28f13ea5b with Priority: HIGHEST for action port [ 921.567465] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab92af9-cff5-4b89-8c84-ead28f13ea5b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.567557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab92af9-cff5-4b89-8c84-ead28f13ea5b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.567614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab92af9-cff5-4b89-8c84-ead28f13ea5b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.568739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab92af9-cff5-4b89-8c84-ead28f13ea5b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.568739] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab92af9-cff5-4b89-8c84-ead28f13ea5b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.717648] env[65119]: INFO networking_nsxv3.common.synchronization [req-d9d23848-48ca-4965-a811-69b393a14e61 req-7ff47f80-fefa-408f-b335-a4229bdbeda1 tempest-MultipleCreateTestJSON-2146253803 tempest-MultipleCreateTestJSON-2146253803-project-member] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 921.718469] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGHEST for action security_group_members [ 921.719461] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.719461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.919458] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.071891] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cab92af9-cff5-4b89-8c84-ead28f13ea5b [ 922.072159] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.072301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.072375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.072587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.072677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.072776] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cab92af9-cff5-4b89-8c84-ead28f13ea5b already deleted. [ 922.072857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab92af9-cff5-4b89-8c84-ead28f13ea5b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.216943] env[65119]: INFO networking_nsxv3.common.synchronization [req-c7c2e983-6cfe-4f55-a3bd-9d29ce1fef2b req-a92f13c6-18cb-43f9-bcb4-caba38b1c07e tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 922.217415] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 922.217720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.217842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.217908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.218125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.218305] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.218422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.218480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.218637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.218723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.218817] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.425599] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.496798] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 922.497392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.721736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.721736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.721736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.721896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.721896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.722117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.722202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.722202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.722381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.722698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.722698] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 922.749811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.750588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.750588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.750588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.750588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.763562] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 922.928286] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.928787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.928787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.929506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.929506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.929506] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 922.959053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.959654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.959654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.959654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.959786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.973020] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 924.774466] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 4s [ 924.985138] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 924.985478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.985662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.985881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.986088] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.986916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.986916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.986916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.986916] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.492999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.492999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.492999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.493273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.493273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.494054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.494054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.494054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.494054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.494054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.494054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be updated. [ 925.848677] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.848677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.848677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.848677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.848677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.861700] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: IN_PROGRESS for 2s [ 926.784788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 926.784969] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 926.785215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.220848] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 927.220848] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 927.275642] env[65119]: INFO networking_nsxv3.common.synchronization [req-c1d3623a-9744-48b3-837d-d135cb2505c9 req-513f8680-cc94-4f8f-8b3d-83684cf79e71 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 927.276198] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 927.276511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.276637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.276712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.276961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.277410] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.277530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.277596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.277764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.277849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.277946] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.675905] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.676130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.676258] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.676591] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.676851] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.677022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.677144] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.677452] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.677600] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.677822] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.677936] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.678059] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.678171] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.678293] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.678419] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.678554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.697656] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.697829] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.697968] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.698170] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.698485] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-39c2cc69-a7ca-4850-bf80-3d404caabace taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.698660] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.698778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.699168] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.699298] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39c2cc69-a7ca-4850-bf80-3d404caabace',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.780154] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.780382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.780477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.780679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.780784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.780961] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.781062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.781219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.781309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.781365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.781435] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 already deleted. [ 927.781536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.872055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 in Status: SUCCESS [ 927.872241] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 deletion is rescheduled due to dependency. [ 927.872362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.965828] env[65119]: INFO networking_nsxv3.common.synchronization [req-c04a0b40-951a-48c9-920b-235ba9ecc8d5 req-e62033e3-1940-4671-9c47-6370197d24db tempest-ServerTagsTestJSON-398088808 tempest-ServerTagsTestJSON-398088808-project-member] Enqueued Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 927.966351] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGHEST for action security_group_members [ 927.966656] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.966781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.966848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.967143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.967319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.967426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.967489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.967644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.967727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.967818] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.202410] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.202785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.203050] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.203535] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.203649] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.203840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 39c2cc69-a7ca-4850-bf80-3d404caabace not found, creating... [ 928.204171] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.204383] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.204512] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.204747] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.204885] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.205286] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.205452] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.205583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.205856] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.206048] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.206229] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 39c2cc69-a7ca-4850-bf80-3d404caabace is going to be created. [ 928.228034] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.228368] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.228415] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.228661] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.228885] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.229143] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.471085] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.471262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.471338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.471599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.471696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.471910] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.471998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.472074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.472236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.472316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.472403] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40309f57-4f06-40c4-9838-656b00d3acea is going to be updated. [ 928.504770] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.505039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.505200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.505534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.505761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.518407] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: IN_PROGRESS for 2s [ 928.974216] env[65119]: INFO networking_nsxv3.common.synchronization [req-c1d3623a-9744-48b3-837d-d135cb2505c9 req-bf15bcd9-9622-455b-9d2f-7d577e416a86 service nova] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 928.974449] env[65119]: INFO networking_nsxv3.common.synchronization [req-c1d3623a-9744-48b3-837d-d135cb2505c9 req-bf15bcd9-9622-455b-9d2f-7d577e416a86 service nova] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 928.974529] env[65119]: INFO networking_nsxv3.common.synchronization [req-c1d3623a-9744-48b3-837d-d135cb2505c9 req-bf15bcd9-9622-455b-9d2f-7d577e416a86 service nova] Enqueued Resource ID: 39c2cc69-a7ca-4850-bf80-3d404caabace with Priority: HIGHEST for action port [ 928.975027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 928.975192] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 928.975300] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c2cc69-a7ca-4850-bf80-3d404caabace with Priority: HIGHEST for action port [ 928.975573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.975694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.975761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.975952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.976049] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.977217] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.977217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.977217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.977217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.977722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.977828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.977896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.978070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.978202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.978307] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.979017] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-39c2cc69-a7ca-4850-bf80-3d404caabace taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.979127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.980028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.980028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.980028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39c2cc69-a7ca-4850-bf80-3d404caabace',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.481845] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.483020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.483340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.483635] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39c2cc69-a7ca-4850-bf80-3d404caabace with status ACTIVE [ 929.483839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.484042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.484042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.484328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.484450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.484722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.484875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.484875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.485200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.485370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.485550] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.485852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.485852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.485950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.486108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.486211] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39c2cc69-a7ca-4850-bf80-3d404caabace is going to be updated. [ 929.513608] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.513755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.513848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.514040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.514184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.514344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39c2cc69-a7ca-4850-bf80-3d404caabace" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.706875] env[65119]: INFO networking_nsxv3.common.synchronization [req-fb2024d4-7a95-4ab3-bd15-2de0b3d45c78 req-cf073947-2b78-4966-a36d-b0d682b68266 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 929.707708] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 929.708180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.708361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.708463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.708757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.708995] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.709158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.709275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.709503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.709676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.709803] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.988906] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.042748] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.042905] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.043016] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.043299] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.043546] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.043999] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.043999] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.044118] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.044185] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.044386] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.044498] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.044606] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.044712] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.044821] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.044925] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.045066] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.063994] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.064193] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.064331] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.064573] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.064820] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-4361968f-09ac-4166-8910-c624dca5d0cb taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.064992] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.065145] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.065585] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.065812] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4361968f-09ac-4166-8910-c624dca5d0cb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.212716] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.212963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.213131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.213463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.213626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.213943] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.214126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.214234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.214498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.214629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.214782] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 930.243226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.243400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.243445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.243632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.243767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.252897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 930.491126] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.491581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.491581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.491670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.491706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.491812] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be created. [ 930.515248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.515248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.515248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.517047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.517047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.527274] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40309f57-4f06-40c4-9838-656b00d3acea in Status: SUCCESS [ 930.527576] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40309f57-4f06-40c4-9838-656b00d3acea deletion is rescheduled due to dependency. [ 930.527751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.528720] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: UNINITIALIZED for 2s [ 930.568108] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.568476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.568668] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.568957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.569440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 4361968f-09ac-4166-8910-c624dca5d0cb not found, creating... [ 930.569735] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.569907] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.570040] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.570290] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.570449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.570743] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.570902] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.571035] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.571311] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.571391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.571528] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 4361968f-09ac-4166-8910-c624dca5d0cb is going to be created. [ 930.592370] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.592639] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.592694] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.592937] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.593177] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.593408] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.306341] env[65119]: INFO networking_nsxv3.common.synchronization [req-fb2024d4-7a95-4ab3-bd15-2de0b3d45c78 req-808aaac7-cddf-43e7-86a3-6aab866412ce service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 931.306522] env[65119]: INFO networking_nsxv3.common.synchronization [req-fb2024d4-7a95-4ab3-bd15-2de0b3d45c78 req-808aaac7-cddf-43e7-86a3-6aab866412ce service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 931.306661] env[65119]: INFO networking_nsxv3.common.synchronization [req-fb2024d4-7a95-4ab3-bd15-2de0b3d45c78 req-808aaac7-cddf-43e7-86a3-6aab866412ce service nova] Enqueued Resource ID: 4361968f-09ac-4166-8910-c624dca5d0cb with Priority: HIGHEST for action port [ 931.307224] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 931.307366] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 931.307467] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361968f-09ac-4166-8910-c624dca5d0cb with Priority: HIGHEST for action port [ 931.307736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.307861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.307922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.310471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.310569] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.311482] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.311573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.311776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4361968f-09ac-4166-8910-c624dca5d0cb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.311875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.311948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.312143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.312210] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4361968f-09ac-4166-8910-c624dca5d0cb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.815071] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.815362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.815429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4361968f-09ac-4166-8910-c624dca5d0cb with status ACTIVE [ 931.815584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.815694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.815760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.815989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.816069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.816244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.816337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.816401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.816558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.816637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.816811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.816904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.816963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.817119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.817214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.817311] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4361968f-09ac-4166-8910-c624dca5d0cb is going to be updated. [ 931.840547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.840547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.840547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.840673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.840814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.841041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4361968f-09ac-4166-8910-c624dca5d0cb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.169105] env[65119]: INFO networking_nsxv3.common.synchronization [req-4f477db7-5ef5-4b7b-bd16-a85c8cc52b71 req-124aafcf-380c-4cbf-a83a-70beca19962b tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 932.169402] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 932.169728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.169848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.169909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.170371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.170642] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.170642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.170768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.170856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.170937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.171048] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.263044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 932.263044] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e deletion is rescheduled due to dependency. [ 932.263044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.263044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.263272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.263441] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.263568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.263665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.263781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.263890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.263956] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.482028] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.482028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.482028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.482028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.482028] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.482028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.482403] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.482403] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.482466] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.482635] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.482750] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.482859] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.482967] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.483106] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.483215] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.483351] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.503645] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.503645] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.503845] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.503958] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.504913] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-7e0c38a4-7e87-4895-bdbd-4fe476517172 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.504913] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.504913] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.505150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.505278] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0c38a4-7e87-4895-bdbd-4fe476517172',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.539142] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 932.539448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.539596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.539799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.539988] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.540133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.540374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.540414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.540510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.540580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.540671] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.672788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.672945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.673036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.673253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.673388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.673531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.673647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.673698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.673836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.673909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.673990] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f already deleted. [ 932.674077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.766873] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.007509] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.007927] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.007927] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.008085] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.008233] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.008385] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 7e0c38a4-7e87-4895-bdbd-4fe476517172 not found, creating... [ 933.008639] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.008795] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.008911] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.009145] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.009346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.009618] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.009772] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.009886] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.010109] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.010316] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.010411] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 7e0c38a4-7e87-4895-bdbd-4fe476517172 is going to be created. [ 933.030444] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.030699] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.030823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.031108] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.031344] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.031582] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.042795] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.268171] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.546689] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2d1c57-a6bd-4f0c-9911-e018a46e3355: rpc.has_security_group_logging(os_id): False [ 933.567587] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.567797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.567859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.568117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.568187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.568390] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.568542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.568595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.568708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.568784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.568871] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be created. [ 933.638037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.638246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.638246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.638466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.638648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.650771] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 933.770645] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.770811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.770884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.771133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.771228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.771336] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 933.791755] env[65119]: INFO networking_nsxv3.common.synchronization [req-4f477db7-5ef5-4b7b-bd16-a85c8cc52b71 req-25e4dfb1-dbf4-493d-a272-dcef27fa4761 service nova] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_rules [ 933.791901] env[65119]: INFO networking_nsxv3.common.synchronization [req-4f477db7-5ef5-4b7b-bd16-a85c8cc52b71 req-25e4dfb1-dbf4-493d-a272-dcef27fa4761 service nova] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 933.792467] env[65119]: INFO networking_nsxv3.common.synchronization [req-4f477db7-5ef5-4b7b-bd16-a85c8cc52b71 req-25e4dfb1-dbf4-493d-a272-dcef27fa4761 service nova] Enqueued Resource ID: 7e0c38a4-7e87-4895-bdbd-4fe476517172 with Priority: HIGHEST for action port [ 933.792652] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_rules [ 933.792809] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 933.792912] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0c38a4-7e87-4895-bdbd-4fe476517172 with Priority: HIGHEST for action port [ 933.794375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.794621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.794621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.795464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.795464] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.797080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.797080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.797080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.797080] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.798449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0c38a4-7e87-4895-bdbd-4fe476517172 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.798620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.798620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.799964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.799964] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0c38a4-7e87-4895-bdbd-4fe476517172',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.845500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.845849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.845849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.845993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.846495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.860925] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 934.303732] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.305012] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.305435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.306104] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e0c38a4-7e87-4895-bdbd-4fe476517172 with status ACTIVE [ 934.306104] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.306221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.306259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.306460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.306544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.306722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.306822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.306992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.307366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.307366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.307521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.307640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.308303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.308303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.308303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.308303] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e0c38a4-7e87-4895-bdbd-4fe476517172 is going to be updated. [ 934.330765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.330895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.330993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.331197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.331336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.331499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0c38a4-7e87-4895-bdbd-4fe476517172" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.683177] env[65119]: INFO networking_nsxv3.common.synchronization [req-f84b4e1f-e1ed-4103-b53b-dc879228d57e req-aacc5b5a-cfcc-4254-b31f-16c5e0837d1d tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 934.684128] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 934.684712] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.685049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.806784] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.027899] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.028101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.028225] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.028564] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.029056] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.029146] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.029221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.029541] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.029688] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.029929] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.030056] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.030167] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.030283] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.030388] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.030493] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.030632] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.049807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.050147] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.050147] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.050325] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.050629] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-1786efbf-7134-46bb-813e-b4ed1c15e41e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.050811] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.050933] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.051304] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.051475] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1786efbf-7134-46bb-813e-b4ed1c15e41e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.310401] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.310788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.310788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.311806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.311972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.312149] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be created. [ 935.341608] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.341608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.341608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.341608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.341608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.352373] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: UNINITIALIZED for 2s [ 935.556375] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.556375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.556375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.556375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556375] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 1786efbf-7134-46bb-813e-b4ed1c15e41e not found, creating... [ 935.556375] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.556375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.556771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.558247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.558247] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.558247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.558247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.558247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.559034] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.559852] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 1786efbf-7134-46bb-813e-b4ed1c15e41e is going to be created. [ 935.588441] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.588860] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.589174] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.589698] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.590237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.590491] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.668813] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 935.669556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.871107] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 935.871342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.871516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.871742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.871942] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.872100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.872149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.872295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.872376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.872464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.872557] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.375955] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.394221] env[65119]: INFO networking_nsxv3.common.synchronization [req-f84b4e1f-e1ed-4103-b53b-dc879228d57e req-3f30ada6-c662-4798-ae20-4a7d4e64f1f7 service nova] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_rules [ 936.394221] env[65119]: INFO networking_nsxv3.common.synchronization [req-f84b4e1f-e1ed-4103-b53b-dc879228d57e req-3f30ada6-c662-4798-ae20-4a7d4e64f1f7 service nova] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 936.394221] env[65119]: INFO networking_nsxv3.common.synchronization [req-f84b4e1f-e1ed-4103-b53b-dc879228d57e req-3f30ada6-c662-4798-ae20-4a7d4e64f1f7 service nova] Enqueued Resource ID: 1786efbf-7134-46bb-813e-b4ed1c15e41e with Priority: HIGHEST for action port [ 936.395068] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_rules [ 936.395453] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 936.395699] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1786efbf-7134-46bb-813e-b4ed1c15e41e with Priority: HIGHEST for action port [ 936.396142] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.396420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397139] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397139] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1786efbf-7134-46bb-813e-b4ed1c15e41e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.397703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.397835] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1786efbf-7134-46bb-813e-b4ed1c15e41e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.833196] env[65119]: INFO networking_nsxv3.common.synchronization [req-d10674f3-fcc3-44cb-b100-8ce430f5daf2 req-1c8d85a1-2846-4dc9-8d55-759f228eeaed tempest-ListImageFiltersTestJSON-1838690385 tempest-ListImageFiltersTestJSON-1838690385-project-member] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 936.838028] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGHEST for action security_group_members [ 936.838028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.838028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.838028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.838028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.879828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cec5d72a-5222-4ea2-bb61-5a248eace68e: rpc.has_security_group_logging(os_id): False [ 936.904309] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.904484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.904559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.904779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.904868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.905136] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.905241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.905305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.905463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.905540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.905629] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 936.906950] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1786efbf-7134-46bb-813e-b4ed1c15e41e with status ACTIVE [ 936.908133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.908273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.908338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.908520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.908969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.908969] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.908969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.908969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.909209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.909209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.909402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.909509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.909576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.909716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.909842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.909876] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1786efbf-7134-46bb-813e-b4ed1c15e41e is going to be updated. [ 936.959865] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.959865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.959865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.960163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.960756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.960756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1786efbf-7134-46bb-813e-b4ed1c15e41e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.031317] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.031317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.031317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.031582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.031627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.049932] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 937.306722] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ce671d03-bd38-44e4-ad0d-375170fc99cd tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: 1fc2906a-4d49-4515-a739-0427887feae8 with Priority: HIGHEST for action security_group_rules [ 937.307410] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc2906a-4d49-4515-a739-0427887feae8 with Priority: HIGHEST for action security_group_rules [ 937.307733] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fc2906a-4d49-4515-a739-0427887feae8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.307871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.307948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.308192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.308274] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fc2906a-4d49-4515-a739-0427887feae8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.340058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.340390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.340390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.340597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.340628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.340805] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.340906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.340964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.341139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.341215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.341303] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be updated. [ 937.362847] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 937.363105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.363277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.363493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.363685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.363805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.363872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.364033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.364116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.364229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.368015] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.368899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.369805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.370383] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.370503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.370571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.370739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.370819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.370913] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.377861] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.377861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.377861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.378275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.378758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.395985] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: IN_PROGRESS for 2s [ 937.462662] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e94098e9-31db-40f3-b378-2ea0310f347b tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: 1fc2906a-4d49-4515-a739-0427887feae8 with Priority: HIGHEST for action security_group_rules [ 937.463393] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc2906a-4d49-4515-a739-0427887feae8 with Priority: HIGHEST for action security_group_rules [ 937.464062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fc2906a-4d49-4515-a739-0427887feae8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.464062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.830411] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.830674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.830759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.830973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.831150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.831245] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fc2906a-4d49-4515-a739-0427887feae8 already deleted. [ 937.831341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.831502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.831679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.831764] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fc2906a-4d49-4515-a739-0427887feae8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.874738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.874738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.874738] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.354127] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.354127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.354127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.354127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.354127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.354127] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fc2906a-4d49-4515-a739-0427887feae8 already deleted. [ 938.354127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fc2906a-4d49-4515-a739-0427887feae8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.377198] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.724590] env[65119]: INFO networking_nsxv3.common.synchronization [None req-4261b0a8-4aef-4506-856a-de3e77686b5d tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: af98b578-cd04-4a0b-a451-5222844aa250 with Priority: HIGHEST for action security_group_rules [ 938.725188] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af98b578-cd04-4a0b-a451-5222844aa250 with Priority: HIGHEST for action security_group_rules [ 938.725490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af98b578-cd04-4a0b-a451-5222844aa250 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.725611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.725678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.725931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.726800] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af98b578-cd04-4a0b-a451-5222844aa250',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.876617] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43e375f3-7f64-4fde-9f49-03b4b873c437 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: af98b578-cd04-4a0b-a451-5222844aa250 with Priority: HIGHEST for action security_group_rules [ 938.877760] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af98b578-cd04-4a0b-a451-5222844aa250 with Priority: HIGHEST for action security_group_rules [ 938.877760] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af98b578-cd04-4a0b-a451-5222844aa250 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.878375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.879492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.880804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.880963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.881210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.881382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.881451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 938.920987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.921282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.921282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.921414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.921621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.934553] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 939.082900] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 939.083171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.109241] env[65119]: INFO networking_nsxv3.common.synchronization [req-bcfe7f67-5d42-4241-a86a-280e650266ac req-4a7c9b1f-bd01-4cb0-afec-f87cc5083e91 tempest-ServersAdminTestJSON-1364747705 tempest-ServersAdminTestJSON-1364747705-project-member] Enqueued Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 939.109845] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4688087-743d-4d09-ac40-3272e1f90bc5 with Priority: HIGHEST for action security_group_members [ 939.110197] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4688087-743d-4d09-ac40-3272e1f90bc5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.110386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.110457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.110838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.111077] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.111176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.111245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.111417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.112233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.112233] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4688087-743d-4d09-ac40-3272e1f90bc5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.254537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.254537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.254537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.255048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.255135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.255278] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af98b578-cd04-4a0b-a451-5222844aa250 already deleted. [ 939.255398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.255637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.255716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.256645] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af98b578-cd04-4a0b-a451-5222844aa250',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.408050] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a096698e-b6ff-45f7-a422-2ae93392dd6a in Status: SUCCESS [ 939.408240] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a deletion is rescheduled due to dependency. [ 939.408539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.613862] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.614188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.614188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.614346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.614385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.614878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.615033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.615180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.615244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.615314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.615422] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 is going to be updated. [ 939.644788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.645027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.645152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.645455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.645670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.655094] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: IN_PROGRESS for 2s [ 939.779639] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.779639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.779639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.779639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.779639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.779639] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af98b578-cd04-4a0b-a451-5222844aa250 already deleted. [ 939.779639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af98b578-cd04-4a0b-a451-5222844aa250" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.813260] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8ea0534-a5b1-4be9-9556-259e80d8d77c req-dade31e4-3774-49dd-bd52-d3e37be8de3a tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 939.814037] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 939.814424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.814568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.814654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.814997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.815244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.815536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.815536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.815689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.815787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.815913] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.144992] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1e08b96d-849f-495d-85b5-a784f5153bb0 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 940.145761] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 940.146359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.146542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.146542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.147061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.147186] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.172442] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-283 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.172662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.172766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.173099] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.173362] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.173529] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.173649] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.173916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.174080] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.174295] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.174413] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.174525] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.174636] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.174749] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.174857] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.174992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.195782] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.195948] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.196106] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.196294] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.196629] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.196791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.196912] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.197289] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.197431] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.257631] env[65119]: INFO networking_nsxv3.common.synchronization [None req-834fa7f5-8ad7-44fd-97ad-347375eade16 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 940.258188] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 940.258496] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.258613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.318481] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.318481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.318481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.318481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.318714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.318714] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.318936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.318936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.319038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.319128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.319165] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 already deleted. [ 940.319531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.667222] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.667383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.667457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.667844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.667844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.667844] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 already deleted. [ 940.668019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.668087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.668243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.668331] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.701364] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.701666] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.701831] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.702176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.702388] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.702585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb not found, creating... [ 940.702854] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.703034] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.703157] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.703466] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.703502] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.703793] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.703982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.704066] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.704269] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.704403] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.704580] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb is going to be created. [ 940.727064] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.727247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.727385] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.727656] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.727877] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.728120] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.945597] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 940.945971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.945971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.946205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.946382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.946501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.946570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.946727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.946808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.946905] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.191653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.191836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.191900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.192161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.192263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.192361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 already deleted. [ 941.192503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.449297] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.461173] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8ea0534-a5b1-4be9-9556-259e80d8d77c req-e0286262-5b9b-442b-8ab6-78bdef74de7d service nova] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 941.461173] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8ea0534-a5b1-4be9-9556-259e80d8d77c req-e0286262-5b9b-442b-8ab6-78bdef74de7d service nova] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 941.461173] env[65119]: INFO networking_nsxv3.common.synchronization [req-e8ea0534-a5b1-4be9-9556-259e80d8d77c req-e0286262-5b9b-442b-8ab6-78bdef74de7d service nova] Enqueued Resource ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with Priority: HIGHEST for action port [ 941.461173] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 941.461173] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 941.461671] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with Priority: HIGHEST for action port [ 941.461671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.461671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.461833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.461945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.462063] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.462954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.463082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.463139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.463326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.463493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.463600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.463669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.464084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.464084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.464084] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.465226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.466508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.466571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.466823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.466932] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.818082] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4688087-743d-4d09-ac40-3272e1f90bc5 in Status: SUCCESS [ 941.818351] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4688087-743d-4d09-ac40-3272e1f90bc5 deletion is rescheduled due to dependency. [ 941.818474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4688087-743d-4d09-ac40-3272e1f90bc5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.953656] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.971529] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.972763] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.973108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.973611] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with status ACTIVE [ 941.973914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.975051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.975051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.975506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.975506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.975506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.975506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.975506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.975773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.975773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.975773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb is going to be updated. [ 942.021954] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.022207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.022207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.022398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.022534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.022696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.214016] env[65119]: INFO networking_nsxv3.common.synchronization [req-fce4cce5-671a-4da1-a50c-68885ece0846 req-f5eac601-bd21-48cb-81a7-3c2f79a78de4 tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 942.214629] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 942.214951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.216171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.216275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.216503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.216696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.216808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.216918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.217067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.217155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.217270] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.456973] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.456973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.456973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.457326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.457408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.457545] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 942.475021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.493028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.493028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.493266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.495158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.495158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.504679] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 942.693346] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-358 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.693546] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.693671] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.694076] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.694260] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.694383] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.694502] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.694731] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.694854] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.695074] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.695185] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.695293] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.695401] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.695509] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.695612] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.695740] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.719199] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.719435] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.719582] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.720096] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-358" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.720096] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.720359] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.720455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.720780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.720918] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.721951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.722131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.722131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.722296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.722483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.722678] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.722678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.722862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.722862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.723020] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 942.759656] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.759885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.759885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.760101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.760248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.769438] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 942.871274] env[65119]: INFO networking_nsxv3.common.synchronization [req-49a701ff-814f-4862-8a0b-5782fde8ce37 req-3da1d45c-2ff9-44b9-9af7-99ece9a905d7 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 942.871943] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 942.872664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.872664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.872664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.872664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.872994] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.872994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.872994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.873194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.873241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.873315] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.979089] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.979511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.979511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.979609] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.979735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.979804] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be created. [ 943.007428] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.007601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.007660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.007886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.008063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.018448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: UNINITIALIZED for 2s [ 943.225545] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.226014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.226281] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.230053] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 not found, creating... [ 943.230053] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.230053] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.230053] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.230451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.230451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.230451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.230451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 is going to be created. [ 943.258993] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.259228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.259422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.259703] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.259926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.260168] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.377831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.378204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.378346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.378672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.378826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.379161] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.379373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.379472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.379743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.379884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.380087] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 943.457432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.457625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.457723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.458259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.458259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.477308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 944.047914] env[65119]: INFO networking_nsxv3.common.synchronization [req-fce4cce5-671a-4da1-a50c-68885ece0846 req-35dc6378-a146-487e-a034-4a4b0af1010c service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 944.048205] env[65119]: INFO networking_nsxv3.common.synchronization [req-fce4cce5-671a-4da1-a50c-68885ece0846 req-35dc6378-a146-487e-a034-4a4b0af1010c service nova] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 944.048412] env[65119]: INFO networking_nsxv3.common.synchronization [req-fce4cce5-671a-4da1-a50c-68885ece0846 req-35dc6378-a146-487e-a034-4a4b0af1010c service nova] Enqueued Resource ID: cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 with Priority: HIGHEST for action port [ 944.049499] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_rules [ 944.049753] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 944.049926] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 with Priority: HIGHEST for action port [ 944.050437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.050628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.050744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.051058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.051183] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.052378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.052550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.054511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.055083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.055805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.055805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.055805] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.518618] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 944.518829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.519095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.520370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.520617] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.520802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.520880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.521070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.521157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.521365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.521533] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.521723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.521782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.522181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.522480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.522602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.522677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.522843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.523198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.523351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.523844] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.558318] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.558318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.558434] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 with status ACTIVE [ 944.559479] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.559479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.559860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.559860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.559860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.560109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.560200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.560256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.560416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.560494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.560814] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.560814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.560898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.561066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.561145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.561194] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79 is going to be updated. [ 944.582590] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.582817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.582817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.583156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.583156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.583340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb7909c7-4e1d-47b0-8a60-c1eb74ec3c79" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.782122] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 4s [ 945.026897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9c0dc90-8346-4983-bb7f-1dc141d9364f: rpc.has_security_group_logging(os_id): False [ 945.028769] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: SUCCESS [ 945.029042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.029270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.029595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.029842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.029977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.030054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.030206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.030284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.030371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.030485] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.054249] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.054725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.054725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.054825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.054933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.055253] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.055397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.055491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.055700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.055786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.055973] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.056085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.056149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.056291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.056365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.056564] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.056659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.056720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.056862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.056935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.057035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be created. [ 945.123702] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.124142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.124302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.124670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.124918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.138739] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 945.489136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 945.489391] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 945.489482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.533109] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.035795] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e282651-46df-44c0-8922-eca67aa74d66: rpc.has_security_group_logging(os_id): False [ 946.056548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.056548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.056894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.056894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.056894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.057503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.057986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.057986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.057986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.057986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.057986] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be created. [ 946.134133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.134298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.134372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.134591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.134817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.147645] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: IN_PROGRESS for 2s [ 946.794339] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 946.794757] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 946.794900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.796991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.796991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.796991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.796991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.796991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.797342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.797633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.798389] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.152440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 947.152846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.152846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.153050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.153133] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.301916] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.657636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.657636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.657636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.657636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.805037] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.159147] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.159536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.159536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.159705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.159872] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.159978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.160053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.160198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.160285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.160390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.160539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.160631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.160692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.160831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.160966] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.161069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.161130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.161305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.161376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.161410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.161493] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.163014] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: SUCCESS [ 948.163268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.307427] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.307427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.307688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.307688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.307817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.307890] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 948.341307] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.341453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.341522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.341775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.341925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.353966] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 948.665170] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9c0dc90-8346-4983-bb7f-1dc141d9364f: rpc.has_security_group_logging(os_id): False [ 948.685833] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.685986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.686067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.686273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.686366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.686588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.686692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.686758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.686912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.686988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.687173] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.687299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.687389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.688031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.688031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.688031] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.688031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.688031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.688266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.688266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.688266] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 948.753088] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.753246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.753305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.753544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.753792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.765825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 949.050872] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 949.051071] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 950.363565] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 950.363842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.364015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.364198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.364395] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.364548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.364597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.364719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.364798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.364883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.364977] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.780329] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 950.780560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.867717] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.867717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.867717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.867717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.868108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.868285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.869013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.869275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.869473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.869619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.869828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.869934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.869999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.870174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.870326] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.870419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.870472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.870615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.870694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.870774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.870864] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.999658] env[65119]: INFO networking_nsxv3.common.synchronization [req-858c2873-27e3-4506-8481-5afd5a5020a4 req-740bffc9-e85a-4a14-80d8-919aa7fe17c4 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 951.000222] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 951.000566] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.000693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.000761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.001160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.001500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.001618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.001686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.001843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.001929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.002040] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.373413] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a32e7cc-5871-4cac-93b4-13eb1e04d001: rpc.has_security_group_logging(os_id): False [ 951.393519] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.393519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.393519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.393519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.393519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.394051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394234] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.394550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394774] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.395102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.395177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.395269] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 951.469986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.470198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.470270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.470496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.470721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.488575] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 951.503734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.503953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.504024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.504240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.504806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.505315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.505509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.505636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.505959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.506288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.506416] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 951.540559] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.540784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.540839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.541058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.541253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.558366] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 953.506484] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 953.507092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.571319] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 953.571319] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 953.571319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.105129] env[65119]: INFO networking_nsxv3.common.synchronization [req-3271bdbb-a61d-4e2b-b715-2f68ff52512f req-baf297d1-0f3e-4973-b56a-2e2f301244fa tempest-ServersTestManualDisk-260502750 tempest-ServersTestManualDisk-260502750-project-member] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 955.105655] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGHEST for action security_group_members [ 955.106127] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.106127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.106382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.106511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.106699] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.106884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.106981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.107535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.107535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.107535] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.846875] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.846875] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.846875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.846875] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 is going to be updated. [ 955.851200] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.851200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.851200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.851200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.851200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.872698] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: IN_PROGRESS for 2s [ 957.547080] env[65119]: INFO networking_nsxv3.common.synchronization [None req-36acb0cc-dfe4-4451-a67d-5f3d92186649 None None] Enqueued Resource ID: 4a5e2744-585e-4b77-b40e-3be6202f901a with Priority: HIGHEST for action port [ 957.547779] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5e2744-585e-4b77-b40e-3be6202f901a with Priority: HIGHEST for action port [ 957.549266] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a5e2744-585e-4b77-b40e-3be6202f901a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.549773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a5e2744-585e-4b77-b40e-3be6202f901a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.549773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a5e2744-585e-4b77-b40e-3be6202f901a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.549906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a5e2744-585e-4b77-b40e-3be6202f901a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.550062] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5e2744-585e-4b77-b40e-3be6202f901a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.885052] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb24203d-c552-4146-a5ac-8b7d840c9508 in Status: SUCCESS [ 957.886023] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 deletion is rescheduled due to dependency. [ 957.886023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.054064] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a5e2744-585e-4b77-b40e-3be6202f901a [ 958.054377] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.054613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.054613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.054716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.054799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.055011] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a5e2744-585e-4b77-b40e-3be6202f901a already deleted. [ 958.055011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a5e2744-585e-4b77-b40e-3be6202f901a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.310161] env[65119]: INFO networking_nsxv3.common.synchronization [req-f25c7550-f468-4e15-bcc7-fde9ef55d882 req-6e3efc10-a2a1-4542-b5c2-14644f110c96 tempest-ServerExternalEventsTest-474317447 tempest-ServerExternalEventsTest-474317447-project-member] Enqueued Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 958.310816] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 958.311021] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.311470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.311549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.311839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.313818] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.313934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.314011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.314192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.314280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.314375] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.568759] env[65119]: INFO networking_nsxv3.common.synchronization [None req-85faed38-320f-4e76-bfb1-933ad0ff4fa4 None None] Enqueued Resource ID: 477fe614-9162-4ac9-96a2-9368984d1bdf with Priority: HIGHEST for action port [ 958.569358] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477fe614-9162-4ac9-96a2-9368984d1bdf with Priority: HIGHEST for action port [ 958.569702] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-477fe614-9162-4ac9-96a2-9368984d1bdf taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.569831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-477fe614-9162-4ac9-96a2-9368984d1bdf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.569890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-477fe614-9162-4ac9-96a2-9368984d1bdf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.570243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-477fe614-9162-4ac9-96a2-9368984d1bdf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.570432] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477fe614-9162-4ac9-96a2-9368984d1bdf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.717157] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.717506] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.717575] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.717899] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.718257] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.718617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.718617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.718802] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.718951] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.719190] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.719278] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.719547] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.719614] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.719694] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.719790] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.719921] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.739691] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.739873] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.740024] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.740201] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-512" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.740604] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-256ca200-f32d-49c7-9968-b791be22403a taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.740773] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.740897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.741252] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.741618] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('256ca200-f32d-49c7-9968-b791be22403a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.817019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.817274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.817274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.817737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.817737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.817832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.817930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.817979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.818165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.818668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.818668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 already deleted. [ 958.818668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.072394] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 477fe614-9162-4ac9-96a2-9368984d1bdf [ 959.072656] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.072814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.072906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.073185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.073317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.073437] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:477fe614-9162-4ac9-96a2-9368984d1bdf already deleted. [ 959.073546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-477fe614-9162-4ac9-96a2-9368984d1bdf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.246956] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.246956] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 256ca200-f32d-49c7-9968-b791be22403a not found, creating... [ 959.246956] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.246956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.247459] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.247459] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.247459] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.247459] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.248111] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.248411] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 256ca200-f32d-49c7-9968-b791be22403a is going to be created. [ 959.269029] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.269029] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.269029] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.269313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.269659] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.269874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.710803] env[65119]: INFO networking_nsxv3.common.synchronization [req-0c314e07-12cb-42a6-89ad-faef70c4af0b req-c4c736ed-a573-494f-829e-8341383ec118 tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 959.711408] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 959.711736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.711879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.711950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.712771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.712875] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.712982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.713050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.713211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.713296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.713388] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.020328] env[65119]: INFO networking_nsxv3.common.synchronization [req-f25c7550-f468-4e15-bcc7-fde9ef55d882 req-db17dcb2-2d3f-415d-b4a5-fb01d030dd90 service nova] Enqueued Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_rules [ 960.020506] env[65119]: INFO networking_nsxv3.common.synchronization [req-f25c7550-f468-4e15-bcc7-fde9ef55d882 req-db17dcb2-2d3f-415d-b4a5-fb01d030dd90 service nova] Enqueued Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 960.020694] env[65119]: INFO networking_nsxv3.common.synchronization [req-f25c7550-f468-4e15-bcc7-fde9ef55d882 req-db17dcb2-2d3f-415d-b4a5-fb01d030dd90 service nova] Enqueued Resource ID: 256ca200-f32d-49c7-9968-b791be22403a with Priority: HIGHEST for action port [ 960.021291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_rules [ 960.021361] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 960.021401] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256ca200-f32d-49c7-9968-b791be22403a with Priority: HIGHEST for action port [ 960.022063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.022063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.022063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.022063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.022281] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.025978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.025978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.025978] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.025978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-256ca200-f32d-49c7-9968-b791be22403a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.025978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.025978] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('256ca200-f32d-49c7-9968-b791be22403a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.161406] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.161694] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.161752] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.161990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.162271] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.162433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.162551] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.162797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.163029] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.163122] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.163232] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.163339] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.163443] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.163553] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.163766] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.163766] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.184272] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a2f1ff7d-036f-41b8-a159-fd9df2f2c576 None None] Enqueued Resource ID: f89810c4-a3b5-4bd0-82a3-35367788c82b with Priority: HIGHEST for action port [ 960.185428] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.185655] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.185864] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.186125] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.190030] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-ea298994-88a6-4b30-b78d-81674a3bac4c taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.190030] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea298994-88a6-4b30-b78d-81674a3bac4c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.190030] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f89810c4-a3b5-4bd0-82a3-35367788c82b with Priority: HIGHEST for action port [ 960.190030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-f89810c4-a3b5-4bd0-82a3-35367788c82b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f89810c4-a3b5-4bd0-82a3-35367788c82b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f89810c4-a3b5-4bd0-82a3-35367788c82b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.190030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f89810c4-a3b5-4bd0-82a3-35367788c82b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.190030] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f89810c4-a3b5-4bd0-82a3-35367788c82b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.218648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.218648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.218794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.219309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.220313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.221484] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.221484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.221484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.221484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.221484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.221484] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 960.250291] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.250471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.250543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.250765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.250943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.260798] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 960.527663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.527663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.529878] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.529878] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 256ca200-f32d-49c7-9968-b791be22403a with status ACTIVE [ 960.529878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.529878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.529878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.530282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.530282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.530282] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.530381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.530490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.531977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.532085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.532471] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.532471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.532636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.532670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.532785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.532827] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 256ca200-f32d-49c7-9968-b791be22403a is going to be updated. [ 960.556918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.557175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.557175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.557357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.557550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.557722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-256ca200-f32d-49c7-9968-b791be22403a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.713997] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.713997] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port ea298994-88a6-4b30-b78d-81674a3bac4c not found, creating... [ 960.713997] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.713997] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.715579] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.715579] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: ea298994-88a6-4b30-b78d-81674a3bac4c is going to be created. [ 960.715579] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f89810c4-a3b5-4bd0-82a3-35367788c82b [ 960.715579] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.715579] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f89810c4-a3b5-4bd0-82a3-35367788c82b already deleted. [ 960.715579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f89810c4-a3b5-4bd0-82a3-35367788c82b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.728031] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.729823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.729823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.729823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.729994] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.730527] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.997365] env[65119]: INFO networking_nsxv3.common.synchronization [None req-923d7a16-3d92-4863-bd77-1efab8bdbf9f None None] Enqueued Resource ID: e2578158-cc5f-4fa6-8519-f0980593e476 with Priority: HIGHEST for action port [ 960.997365] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2578158-cc5f-4fa6-8519-f0980593e476 with Priority: HIGHEST for action port [ 960.997365] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2578158-cc5f-4fa6-8519-f0980593e476 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.997365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2578158-cc5f-4fa6-8519-f0980593e476" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.001168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2578158-cc5f-4fa6-8519-f0980593e476" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.001661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2578158-cc5f-4fa6-8519-f0980593e476" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.001661] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2578158-cc5f-4fa6-8519-f0980593e476',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.034690] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.505249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2578158-cc5f-4fa6-8519-f0980593e476 [ 961.506450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.506450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.506450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.506785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.506785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.506785] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2578158-cc5f-4fa6-8519-f0980593e476 already deleted. [ 961.506927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2578158-cc5f-4fa6-8519-f0980593e476" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.507827] env[65119]: INFO networking_nsxv3.common.synchronization [req-0c314e07-12cb-42a6-89ad-faef70c4af0b req-68ec2868-f5ec-4bc8-b7f2-99fba77b681b service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 961.508016] env[65119]: INFO networking_nsxv3.common.synchronization [req-0c314e07-12cb-42a6-89ad-faef70c4af0b req-68ec2868-f5ec-4bc8-b7f2-99fba77b681b service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 961.508265] env[65119]: INFO networking_nsxv3.common.synchronization [req-0c314e07-12cb-42a6-89ad-faef70c4af0b req-68ec2868-f5ec-4bc8-b7f2-99fba77b681b service nova] Enqueued Resource ID: ea298994-88a6-4b30-b78d-81674a3bac4c with Priority: HIGHEST for action port [ 961.508755] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 961.509527] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 961.509527] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea298994-88a6-4b30-b78d-81674a3bac4c with Priority: HIGHEST for action port [ 961.509754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.509873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.509937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.510119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.510200] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.511176] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.511292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.511378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea298994-88a6-4b30-b78d-81674a3bac4c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.511516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.511596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.511826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.511826] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea298994-88a6-4b30-b78d-81674a3bac4c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.537093] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.537433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.537433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.537552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.537594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.537704] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 is going to be created. [ 961.567732] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.568041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.568204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.568550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.568828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.581257] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: UNINITIALIZED for 2s [ 962.013270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.013554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.015805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea298994-88a6-4b30-b78d-81674a3bac4c with status ACTIVE [ 962.015993] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.016131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.016203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.016440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.016535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.016743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.016842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.016923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.017105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.017149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.017338] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.017440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.017520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.017667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.017823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.017942] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea298994-88a6-4b30-b78d-81674a3bac4c is going to be updated. [ 962.044265] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.044454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.044496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.044743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.044885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.045060] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea298994-88a6-4b30-b78d-81674a3bac4c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.274816] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 962.274816] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d deletion is rescheduled due to dependency. [ 962.274816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.274816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.274816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.274816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.274816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.274816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.275288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.275288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.275288] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.777571] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.280968] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.360365] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2ec18f9-2051-4dfc-bfc5-306d75fd7e39 req-ca98d6f5-6b14-4a01-ab06-18ecf49ccbce tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 963.360788] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 963.362405] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.362738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.363269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.363633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.364167] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.365035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.365035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.365035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.365035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.365035] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.605417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: SUCCESS [ 963.605612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.605717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.605974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.606332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.606521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.606521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.606699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.606786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.606883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.606966] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.731679] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.731903] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.732043] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.732308] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.732564] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.732720] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.732838] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.733139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.733326] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.733560] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.733701] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.733835] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.734048] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.734217] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.734355] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.734513] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.754890] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.754890] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.754890] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.756202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.756202] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-2d10651e-17be-4db2-8d73-9a63d51493ec taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.756202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.756202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.756445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.756772] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d10651e-17be-4db2-8d73-9a63d51493ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.782598] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.782824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.783807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.783807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.783807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.783807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 963.815314] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.815598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.815662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.815969] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.816216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.825928] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 963.870824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.871031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.871086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.871278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.871371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.872028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.872028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.872028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.872028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.872028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.872028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f already deleted. [ 963.872319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.109357] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.109648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.109710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.109933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.110118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.110207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.110272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.110493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.110659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.110725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.110880] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.110974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.111051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.111199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.111338] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.111427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.111487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.111623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.111696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.111814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.111861] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.260547] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.260714] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.260876] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.261387] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.261583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.261810] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 2d10651e-17be-4db2-8d73-9a63d51493ec not found, creating... [ 964.262206] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.262435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.262604] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.263088] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.263172] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.263493] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.263715] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.263865] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.264149] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.264324] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.264534] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 2d10651e-17be-4db2-8d73-9a63d51493ec is going to be created. [ 964.292072] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.292479] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.293828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.293828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.293828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.293828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.614067] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1befdc0c-fdef-47d8-a265-90eb419b7428: rpc.has_security_group_logging(os_id): False [ 964.632745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.632926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.633040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.633266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.633381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.633636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.633761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.633831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.634019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.634112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.634308] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.634419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.634485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.634647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.634738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.635041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.635137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.635137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.635295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.635400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.635530] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 is going to be created. [ 964.664658] env[65119]: INFO networking_nsxv3.common.synchronization [req-5cc15983-be85-4217-882c-5b92383663ec req-0e35a825-c3aa-40d1-a79e-6f904099ab32 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 964.665291] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 964.665980] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.665980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.665980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.665980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.666260] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.666374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.666468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.666701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.666789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.666880] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.694227] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.694382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.694482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.694655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.694836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.707754] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: IN_PROGRESS for 2s [ 965.013381] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2ec18f9-2051-4dfc-bfc5-306d75fd7e39 req-365bcf67-f09c-4142-b3d6-cc02691754bd service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 965.013572] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2ec18f9-2051-4dfc-bfc5-306d75fd7e39 req-365bcf67-f09c-4142-b3d6-cc02691754bd service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 965.013711] env[65119]: INFO networking_nsxv3.common.synchronization [req-c2ec18f9-2051-4dfc-bfc5-306d75fd7e39 req-365bcf67-f09c-4142-b3d6-cc02691754bd service nova] Enqueued Resource ID: 2d10651e-17be-4db2-8d73-9a63d51493ec with Priority: HIGHEST for action port [ 965.014296] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 965.014437] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 965.014570] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d10651e-17be-4db2-8d73-9a63d51493ec with Priority: HIGHEST for action port [ 965.014862] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.014987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.015078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.015341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.015464] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.016602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.016737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.016838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.016936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.020138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.020138] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.020138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d10651e-17be-4db2-8d73-9a63d51493ec taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.020138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.020138] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d10651e-17be-4db2-8d73-9a63d51493ec',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.169382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.169626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.169685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.169845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.169933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.170145] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.170282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.170282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.170546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.170643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.170721] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 965.202133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.202331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.202331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.202680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.202680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.206230] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.206435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.206544] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.206923] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.207140] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.207727] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.207727] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.207859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.208049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.208243] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.208358] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.208463] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.209317] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.209317] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.209317] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.209317] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.213550] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 965.231665] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.231907] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 965.232069] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.232247] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.232567] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-1947364a-9d9b-4964-8ad6-971f91d22947 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.232745] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.232865] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.233202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.233454] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1947364a-9d9b-4964-8ad6-971f91d22947',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.522226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.522655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.523510] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.526030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d10651e-17be-4db2-8d73-9a63d51493ec with status ACTIVE [ 965.526381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.526556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.526629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.526952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.527072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.527734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.527734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.527734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.528047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.528047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.528340] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.528414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.528484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.529266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.529266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.529266] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d10651e-17be-4db2-8d73-9a63d51493ec is going to be updated. [ 965.559816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.560068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.560121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.560429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.560642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.560870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d10651e-17be-4db2-8d73-9a63d51493ec" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.735918] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.736479] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.736638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.736926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.737093] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.737308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 1947364a-9d9b-4964-8ad6-971f91d22947 not found, creating... [ 965.737572] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.737741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.738146] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.738146] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.738251] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.738581] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.739124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.739270] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.739591] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.739739] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.739889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 1947364a-9d9b-4964-8ad6-971f91d22947 is going to be created. [ 965.766878] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.767038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.767621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.767740] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.767991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.768321] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.852429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 965.852429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.852429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.852667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.853077] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.853202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.853202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.853355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.853466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.853570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.854108] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.031262] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.356849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.356849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.356849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.357245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.357245] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.357245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.357245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.357390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.357500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.357548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.357597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.357727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.357797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.357874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.357966] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.528545] env[65119]: INFO networking_nsxv3.common.synchronization [req-5cc15983-be85-4217-882c-5b92383663ec req-31074e84-86d7-4566-8838-b08f642eccec service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 966.528545] env[65119]: INFO networking_nsxv3.common.synchronization [req-5cc15983-be85-4217-882c-5b92383663ec req-31074e84-86d7-4566-8838-b08f642eccec service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 966.528935] env[65119]: INFO networking_nsxv3.common.synchronization [req-5cc15983-be85-4217-882c-5b92383663ec req-31074e84-86d7-4566-8838-b08f642eccec service nova] Enqueued Resource ID: 1947364a-9d9b-4964-8ad6-971f91d22947 with Priority: HIGHEST for action port [ 966.529383] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 966.529695] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 966.530380] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1947364a-9d9b-4964-8ad6-971f91d22947 with Priority: HIGHEST for action port [ 966.530380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.530380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.530380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.530704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.530736] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.531703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.531818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.532055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1947364a-9d9b-4964-8ad6-971f91d22947 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.532232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.532232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.532446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.532446] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1947364a-9d9b-4964-8ad6-971f91d22947',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.536010] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.536010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.536010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.536212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.536212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be created. [ 966.568082] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.568082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.568082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.568082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.568082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.578589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: UNINITIALIZED for 2s [ 966.722512] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: SUCCESS [ 966.722734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.792699] env[65119]: INFO networking_nsxv3.common.synchronization [req-a76f6d4c-6016-4b82-824c-236f4752c051 req-28f19889-6cb0-4a7f-8672-3e07d431fe53 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 966.793173] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 966.795972] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.795972] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.795972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.795972] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.862672] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a698aa11-3871-4c02-b0a5-985be0e71f6d: rpc.has_security_group_logging(os_id): False [ 966.891289] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.891464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.891521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.891741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.891833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.892097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.892202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.892266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.892422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.892499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.892685] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.892779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.892840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.892980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.893069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.893268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.893361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.893421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.893562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.893636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.893724] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 966.976510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.976675] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.976749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.976966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.977133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.021557] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 967.034667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.034913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.035049] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1947364a-9d9b-4964-8ad6-971f91d22947 with status ACTIVE [ 967.035278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.035463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.035567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.035817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.035934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.036170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.036279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.036332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.036514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.036597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.036798] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.036940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.037016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.037164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.037269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.037432] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1947364a-9d9b-4964-8ad6-971f91d22947 is going to be updated. [ 967.063244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.063244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.063244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.063522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.063664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.063811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1947364a-9d9b-4964-8ad6-971f91d22947" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.195908] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.196124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.196266] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.196535] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.197032] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.197298] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.197616] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.197902] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.198475] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.201019] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.201190] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.201284] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.201392] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.201631] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.201673] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.201828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.224429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 967.224664] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 967.224730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.224890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.225157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.225346] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.225466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.225532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.225689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.225775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.225998] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.232558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.232840] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.232923] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.233147] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.233531] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-84feebed-f8e2-4b13-828b-7069c93c02bd taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.233892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.233959] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.234374] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.234573] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84feebed-f8e2-4b13-828b-7069c93c02bd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.297481] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.297680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.297787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.298132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.298315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.298556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.298667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.298731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.298902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.298981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.299082] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 already deleted. [ 967.299162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.728260] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.737544] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.737744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.737860] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.738253] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.738384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.738572] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 84feebed-f8e2-4b13-828b-7069c93c02bd not found, creating... [ 967.739371] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.739371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.739371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.739667] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.739818] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.740559] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.740559] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.740762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.740943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.741089] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.741916] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 84feebed-f8e2-4b13-828b-7069c93c02bd is going to be created. [ 967.762955] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.766778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.766778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.766778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.766778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.766778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.230376] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.591760] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 968.591997] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.592192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.592425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.592630] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.592779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.592824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.592967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.593163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.593306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.593372] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.634041] env[65119]: INFO networking_nsxv3.common.synchronization [req-a76f6d4c-6016-4b82-824c-236f4752c051 req-8675e4cb-88e3-40c8-8ac7-884e69905b22 service nova] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 968.634359] env[65119]: INFO networking_nsxv3.common.synchronization [req-a76f6d4c-6016-4b82-824c-236f4752c051 req-8675e4cb-88e3-40c8-8ac7-884e69905b22 service nova] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 968.634439] env[65119]: INFO networking_nsxv3.common.synchronization [req-a76f6d4c-6016-4b82-824c-236f4752c051 req-8675e4cb-88e3-40c8-8ac7-884e69905b22 service nova] Enqueued Resource ID: 84feebed-f8e2-4b13-828b-7069c93c02bd with Priority: HIGHEST for action port [ 968.635021] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_rules [ 968.635246] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 968.635446] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84feebed-f8e2-4b13-828b-7069c93c02bd with Priority: HIGHEST for action port [ 968.635839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.635977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.636061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.636280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.636383] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.637301] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.637395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.637436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.637639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.637858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.638115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.638115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.639032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.639032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.639032] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.639704] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-84feebed-f8e2-4b13-828b-7069c93c02bd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.639704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.639704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.639908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.639908] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84feebed-f8e2-4b13-828b-7069c93c02bd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.733648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.733648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.733648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.734110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.734110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.734110] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 968.767227] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.767361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.767499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.767692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.767835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.779205] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 969.015806] env[65119]: INFO networking_nsxv3.common.synchronization [req-1bce2878-ca47-4cd7-bbd5-ed8b16d143e9 req-b7fe4842-c744-4770-8b39-2e0d33da8946 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 969.018882] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 969.020330] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.020555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.020647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.020801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.020985] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.021538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.021689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.021886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.022934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.023092] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.041412] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 969.041412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.096504] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.096723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.096792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.097021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.097230] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.097439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.097439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.097646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.097826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.097892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.098081] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.098295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.098295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.098412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.098583] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.098772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.098772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.098961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.099361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.099509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.099610] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.142177] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.143444] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.143612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.143788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84feebed-f8e2-4b13-828b-7069c93c02bd with status ACTIVE [ 969.143977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.144635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.144635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.144635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.144635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.144912] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.144912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.144912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.145050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.145128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.145332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.145496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.145496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.145668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.145762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.145963] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84feebed-f8e2-4b13-828b-7069c93c02bd is going to be updated. [ 969.170531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.170696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.170756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.170956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.171109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.171266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84feebed-f8e2-4b13-828b-7069c93c02bd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.378695] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.378928] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.379100] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.379428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.379778] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.379969] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.380820] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.381554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.381823] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.382197] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.382380] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.382954] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.383183] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.383382] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.383572] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.384059] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.404023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.404023] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.404023] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.404171] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.404470] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-069aac85-2a39-4e23-a24f-a4f6640255d3 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.404648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.404769] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.405124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.405264] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('069aac85-2a39-4e23-a24f-a4f6640255d3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.528869] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.529112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.529207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.529522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.529680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.529936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.530092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.530176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.530364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.530552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.530667] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 969.559714] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.559872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.559945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.560182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.560330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.571621] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 969.603511] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2994e442-555a-4a06-b1c7-b7bebbd61b5f: rpc.has_security_group_logging(os_id): False [ 969.622855] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.623094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.623267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.623512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.623666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.624057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.624229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.624361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.624627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.624740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.625055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.625220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.625327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.625566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.625682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.625957] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.626121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.626214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.626425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.626553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.626690] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be created. [ 969.647774] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.688952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.689142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.689194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.689404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.689663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.700851] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 969.909260] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.909501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.909501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.912977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 069aac85-2a39-4e23-a24f-a4f6640255d3 not found, creating... [ 969.912977] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.912977] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.912977] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.914063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.914063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.914063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.914063] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 069aac85-2a39-4e23-a24f-a4f6640255d3 is going to be created. [ 969.937884] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.938167] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.938348] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.938678] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.938925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.939293] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.150556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.150788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.150788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.151019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.151128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.151239] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 is going to be created. [ 970.186038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.186038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.186038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.186412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.186412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.196983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: UNINITIALIZED for 2s [ 970.792026] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 4s [ 970.849332] env[65119]: INFO networking_nsxv3.common.synchronization [req-81d1fe97-70e6-4f5d-b8b0-ea8b59b8413b req-0f5126e7-3bd1-4134-996a-f4107a619d8b tempest-ImagesTestJSON-2117505294 tempest-ImagesTestJSON-2117505294-project-member] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 970.850191] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGHEST for action security_group_members [ 970.851834] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.851834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.851834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.851834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.851834] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.851834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.851834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.852237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.852237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.852237] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.094121] env[65119]: INFO networking_nsxv3.common.synchronization [req-1bce2878-ca47-4cd7-bbd5-ed8b16d143e9 req-8adeeab2-cf66-4fd0-958c-e6c1fafd8b19 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 971.094121] env[65119]: INFO networking_nsxv3.common.synchronization [req-1bce2878-ca47-4cd7-bbd5-ed8b16d143e9 req-8adeeab2-cf66-4fd0-958c-e6c1fafd8b19 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 971.094121] env[65119]: INFO networking_nsxv3.common.synchronization [req-1bce2878-ca47-4cd7-bbd5-ed8b16d143e9 req-8adeeab2-cf66-4fd0-958c-e6c1fafd8b19 service nova] Enqueued Resource ID: 069aac85-2a39-4e23-a24f-a4f6640255d3 with Priority: HIGHEST for action port [ 971.094121] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 971.094492] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 971.094492] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 069aac85-2a39-4e23-a24f-a4f6640255d3 with Priority: HIGHEST for action port [ 971.094657] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.094775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.094775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.094982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.099459] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.100353] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.100353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.100590] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-069aac85-2a39-4e23-a24f-a4f6640255d3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.100702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.100766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.100958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.101137] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('069aac85-2a39-4e23-a24f-a4f6640255d3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.357735] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.357943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.358614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.358614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.358614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.358614] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.358614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.358938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.358938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.358938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.358938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be updated. [ 971.399329] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.399523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.399618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.399817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.400189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.410051] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: IN_PROGRESS for 2s [ 971.585025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 971.585025] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.585025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.585025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.585025] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.602989] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.603210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.606870] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 069aac85-2a39-4e23-a24f-a4f6640255d3 with status ACTIVE [ 971.607170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.607301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.607384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.607654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.607744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.607994] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.608119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.608182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.608699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.608850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.609094] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.609234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.609321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.609471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.609564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.610672] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 069aac85-2a39-4e23-a24f-a4f6640255d3 is going to be updated. [ 971.634720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.634929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.634970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.635397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.635397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.635560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-069aac85-2a39-4e23-a24f-a4f6640255d3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.732654] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 971.732985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.089189] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.202857] env[65119]: INFO networking_nsxv3.common.synchronization [req-ba5cec55-671b-416d-b966-aa371daafaae req-2da56a2b-7274-4e09-8dc7-7814c9208532 tempest-ServerExternalEventsTest-474317447 tempest-ServerExternalEventsTest-474317447-project-member] Enqueued Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 972.205015] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGHEST for action security_group_members [ 972.206537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.206938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.207155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.207502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.207802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.208184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.208362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.208683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.208896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.209144] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.214191] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: SUCCESS [ 972.214405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.214572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.214774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.215269] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.215269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.215269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.215424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.215543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.215594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.215653] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.593629] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.713369] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.713705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.713705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.713817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.713915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.714133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.714223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.714280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.714459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.714570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.714607] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 is going to be updated. [ 972.721031] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.745648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.745961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.745961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.746259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.746452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.755805] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: IN_PROGRESS for 2s [ 972.814966] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 972.815278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.815495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.815748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.815994] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.816147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.816233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.816507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.816616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.816854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.816982] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.096562] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.096737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.096814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.097055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.097182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.097290] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 973.130248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.130248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.130248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.130526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.130573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.141285] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 973.226428] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78d97212-9ce9-44c7-aea3-cb927043ab34: rpc.has_security_group_logging(os_id): False [ 973.246806] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.246999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.247075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.247262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.247529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.247731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.247843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.247924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.248165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.248256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.248347] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 is going to be created. [ 973.321374] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.321593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.321712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.322033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.322249] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.322366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.322449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.322648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.322798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.322905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.323079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.323174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.323276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.323434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.323575] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.323670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.323730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.323874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.323952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.324054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.324147] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.368359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.368359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.368359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.372283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.372283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.392732] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: IN_PROGRESS for 2s [ 973.421585] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 in Status: SUCCESS [ 973.421929] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 deletion is rescheduled due to dependency. [ 973.422079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.826970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154abdb7-4268-41a3-bf4b-26f5e9656c76: rpc.has_security_group_logging(os_id): False [ 973.849704] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.849932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.850069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.850350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.850454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.850766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.850939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.851119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.851379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.851513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.851832] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.851998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.852123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.852366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.852500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.852825] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.852986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.853177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.853519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.853646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.853806] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 973.955533] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.955652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.955652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.955895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.956036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.973196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 974.114300] env[65119]: INFO networking_nsxv3.common.synchronization [req-43255fd2-554c-4bf7-bbe3-ec62ba441978 req-4ea9794b-a355-4ed2-936b-d73f6646fbe9 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 974.114300] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 974.114300] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.114300] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.114300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.114300] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.516131] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.516131] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.516131] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.516131] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.518190] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.518190] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.518190] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.518190] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.518190] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.518190] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.518190] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.518190] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.518557] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.518557] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.518769] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.518983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.541370] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.541370] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.541370] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.541606] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.543030] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.543030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.543030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.543030] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.543264] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8294aa9e-9105-4fc7-8bcb-4d37887eb05e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.619327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.619500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.619602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.619898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.619898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.620088] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.620183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.620244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.620400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.620475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.620562] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 already deleted. [ 974.620687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.770620] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 in Status: SUCCESS [ 974.770881] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 deletion is rescheduled due to dependency. [ 974.771009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.045923] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.046289] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.046421] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.046712] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.046867] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.047035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 8294aa9e-9105-4fc7-8bcb-4d37887eb05e not found, creating... [ 975.047304] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.047461] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.047617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.047798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.047938] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.048231] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.048385] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.048500] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.048703] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.048837] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.048975] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 8294aa9e-9105-4fc7-8bcb-4d37887eb05e is going to be created. [ 975.071169] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.071415] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.071545] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.071848] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.072098] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.072330] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.170969] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.172554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.172554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.172826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.172826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.172826] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.406214] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: SUCCESS [ 975.406214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.679019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.679019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.679019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.679903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.679903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.680347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.680347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.680449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.680541] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.829378] env[65119]: INFO networking_nsxv3.common.synchronization [req-43255fd2-554c-4bf7-bbe3-ec62ba441978 req-a366aee9-8850-49ce-8c44-e4212620ee9a service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 975.829574] env[65119]: INFO networking_nsxv3.common.synchronization [req-43255fd2-554c-4bf7-bbe3-ec62ba441978 req-a366aee9-8850-49ce-8c44-e4212620ee9a service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 975.829728] env[65119]: INFO networking_nsxv3.common.synchronization [req-43255fd2-554c-4bf7-bbe3-ec62ba441978 req-a366aee9-8850-49ce-8c44-e4212620ee9a service nova] Enqueued Resource ID: 8294aa9e-9105-4fc7-8bcb-4d37887eb05e with Priority: HIGHEST for action port [ 975.831272] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 975.831408] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 975.831510] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8294aa9e-9105-4fc7-8bcb-4d37887eb05e with Priority: HIGHEST for action port [ 975.831802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.831927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.832115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.832382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.832467] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.833409] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.833533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.833664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.833780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.833924] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.837158] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.837158] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.837158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.837158] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8294aa9e-9105-4fc7-8bcb-4d37887eb05e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.987978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 975.988217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.185596] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 976.209193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.209354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.209427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.209748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.209855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.210098] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.210256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.210256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.210439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.210566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.211045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.211156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.211222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.211379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.211447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.211649] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.211737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.211786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.211937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.212626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.212626] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 976.306179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.306179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.306179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.306717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.306913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.326987] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 976.337661] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.338977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.339193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.339448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8294aa9e-9105-4fc7-8bcb-4d37887eb05e with status ACTIVE [ 976.339711] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.340434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.340434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.340434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.340434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.340738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.340823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.340823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.341618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.341618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.341618] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.341618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.341618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.341920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.341920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.342044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8294aa9e-9105-4fc7-8bcb-4d37887eb05e is going to be updated. [ 976.396663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.396882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.396926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.397310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.397600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.397963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8294aa9e-9105-4fc7-8bcb-4d37887eb05e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.710825] env[65119]: INFO networking_nsxv3.common.synchronization [req-44b0eb3c-2c1b-4ab1-8b55-7fb3079f5654 req-2c9309ef-4033-4231-8fb9-7dbc24c92296 tempest-ServerRescueTestJSON-755354593 tempest-ServerRescueTestJSON-755354593-project-member] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 976.713892] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 976.713892] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.713892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.713892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.714415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.715111] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.715294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.715368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.715539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.715635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.715743] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.845958] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.867772] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b22aedca-e5af-4d5e-a44e-05ad15e4ebef tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 976.869436] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 976.870527] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.870527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.870527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.870527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.870792] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.049478] env[65119]: INFO networking_nsxv3.common.synchronization [None req-fc20c9d7-8731-4702-bce2-636fdf32471a tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 977.050208] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 977.050573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.050697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.140150] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.140150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.140150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.140150] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.140438] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.140842] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.140842] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.141035] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.141188] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.141407] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.141511] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.141618] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.141721] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.141828] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.141930] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.142077] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.165996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.166206] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.166330] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.166515] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.166819] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.166989] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.167124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.167451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.167591] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.218642] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.218886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.218886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.219147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.219251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.219466] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.219832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.219832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.219832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.219993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.219993] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 already deleted. [ 977.220114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.348473] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.348683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.348985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.349284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.349412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.349528] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be created. [ 977.389042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.389249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.389302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.389518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.389702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.391980] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.392167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.392209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.392394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.392484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.392582] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 already deleted. [ 977.392679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.393174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.393339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.393431] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.402442] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: UNINITIALIZED for 2s [ 977.672746] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.673022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.673177] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.673476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.673631] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.673821] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf not found, creating... [ 977.674129] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.674310] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.674430] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.674767] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.675013] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.675372] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.675563] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.675688] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.675942] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.676116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.676281] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf is going to be created. [ 977.699516] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.699909] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.700102] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.700426] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.700674] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.700936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.918450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.920387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.920387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.920387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.920387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.920892] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 already deleted. [ 977.920892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.257060] env[65119]: INFO networking_nsxv3.common.synchronization [req-3efc64e2-189c-4c55-b122-fd45a8db4fe4 req-be1bd2bc-310a-4f6d-8594-6ff27a0393fd tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 978.257917] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 978.258096] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.258253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.258300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.258647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.258647] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.258810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.258810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.259015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.259015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.259223] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.365238] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 978.365613] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.454923] env[65119]: INFO networking_nsxv3.common.synchronization [req-44b0eb3c-2c1b-4ab1-8b55-7fb3079f5654 req-2decba63-d998-42a7-9633-ccc4455dd6f6 service nova] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_rules [ 978.455135] env[65119]: INFO networking_nsxv3.common.synchronization [req-44b0eb3c-2c1b-4ab1-8b55-7fb3079f5654 req-2decba63-d998-42a7-9633-ccc4455dd6f6 service nova] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 978.455285] env[65119]: INFO networking_nsxv3.common.synchronization [req-44b0eb3c-2c1b-4ab1-8b55-7fb3079f5654 req-2decba63-d998-42a7-9633-ccc4455dd6f6 service nova] Enqueued Resource ID: b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf with Priority: HIGHEST for action port [ 978.456976] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_rules [ 978.457213] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 978.458843] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf with Priority: HIGHEST for action port [ 978.458843] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.458843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.458843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.459249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.459404] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.461114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.461400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.461812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.463704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.463919] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.464270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.464346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.464599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.464654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.464736] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.466975] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.467167] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.467242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.467479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.467549] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.761799] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.761799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.761799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.761940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.761983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.762619] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.762619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.762619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.762619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.762619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.762619] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 978.796205] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.796528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.796580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.796832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.796988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.806196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 978.970696] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.971736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.972314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.972314] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf with status ACTIVE [ 978.972314] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.973936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.973936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.973936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.974352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.974352] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf is going to be updated. [ 979.001108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.001377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.001377] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.001539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.001728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.001985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a9fd7e-3efc-45f0-9309-9bd347d8c8bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.414208] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 979.414344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.414988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.414988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.414988] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.415198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.415198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.415327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.415715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.415715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.415715] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.476594] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.635200] env[65119]: INFO networking_nsxv3.common.synchronization [req-a6432d8f-b621-4edf-9cd6-811068e92ca1 req-b9cae5c1-f0a7-43fc-b0c4-a60c38316d5a tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 979.635784] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 979.636939] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.637081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.637081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.637300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.637469] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.637647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.637742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.637879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.637989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.638076] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.917669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.917873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.917932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.918135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.918304] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.918860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.918860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.918860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.918860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.919086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.919086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.919180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.919180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.919362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.919456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.919547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.919640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.919800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.919960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.920055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.920148] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.979335] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.979639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.979639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.979791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.979929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.979976] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be created. [ 980.009378] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.009378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.009378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.009378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.009378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.020372] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: UNINITIALIZED for 2s [ 980.140565] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.140759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.140759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.141047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.141179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.141584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.141584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.141748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.141875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.141978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.142114] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 980.175372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.175523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.175617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.175872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.176034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.186987] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 980.424645] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 980.445738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.445738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.445738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.445738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.446536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.446536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.446721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.446808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.447032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.447153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.447219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.447379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.447533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.447613] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be created. [ 980.524560] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.524799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.525024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.541372] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 980.818036] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 980.818261] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 deletion is rescheduled due to dependency. [ 980.818342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.034042] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 982.034418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.034832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.035188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.035460] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.035622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.035728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.035959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.036089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.036216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.036373] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.198381] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 982.198711] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f deletion is rescheduled due to dependency. [ 982.198876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.539410] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.539672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.539774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.539996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.540424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.540567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.540671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.540943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.541127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.541289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.541498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.541636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.542058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.542058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.542226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.542369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.542448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.542529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.542621] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.556651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 982.556903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.046320] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77b26c46-fbab-436a-bd4d-c5014107aa41: rpc.has_security_group_logging(os_id): False [ 983.072116] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.072342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.072444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.072760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.072905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.073343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.073343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.073473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.073629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.073728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.073989] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.078185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.078185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.078185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.078311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.078543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.078686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.078768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.078930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.079046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.081259] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be created. [ 983.152495] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.152495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.152495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.152855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.152855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.180445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 983.393831] env[65119]: INFO networking_nsxv3.common.synchronization [req-755dc882-611d-48cf-8a94-d89df324cf00 req-f8ff140a-536c-495d-a3ed-0561dc648a1c tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 983.394428] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGHEST for action security_group_members [ 983.394941] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.394941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.394941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.395275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.395431] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.395538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.395600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.395851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.395942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.396044] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.898091] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.899053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.899053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.899053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.899053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.899423] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.899423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.899423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.899550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.899550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.899753] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece is going to be updated. [ 983.929711] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.929711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.929711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.929711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.929711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.940108] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: IN_PROGRESS for 2s [ 984.534214] env[65119]: INFO networking_nsxv3.common.synchronization [req-92606f7c-44b4-4d31-b738-701540f52e18 req-88617a8e-c15a-4713-8ee1-9113b1c62cdd tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 984.535126] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 984.535323] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.535511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.535586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.535825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.536064] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.536221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.536341] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.536644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.536750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.536880] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.041300] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.041525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.041525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.041755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.041891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.042522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.042522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.042522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.042522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.042522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.042891] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 985.076252] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.076486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.076486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.076703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.076847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.090335] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 985.197996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 985.198299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.806583] env[65119]: INFO networking_nsxv3.common.synchronization [req-9736f9d4-5150-412c-a9e2-6a53689093b7 req-981473aa-d514-4a13-ac80-79cdacc1bdf8 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 985.813044] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 985.813044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.813044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.813044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.813044] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.952386] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1b3f1f-58a0-4338-b901-3409378a1ece in Status: SUCCESS [ 985.954565] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece deletion is rescheduled due to dependency. [ 985.954565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.320554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.320554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.320554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.320838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.320877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.321090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.321276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.321276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.322543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.322543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.322543] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 986.356285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.356447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.356487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.356691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.356843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.368807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 987.101439] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 987.101439] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d deletion is rescheduled due to dependency. [ 987.101439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.197368] env[65119]: INFO networking_nsxv3.common.synchronization [req-84ff0576-e798-4e98-83c8-44ac56d25f42 req-290389cf-2081-4d39-b581-08ba259e76fb tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 988.199229] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 988.199366] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.200117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.200117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.200117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.200327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.200327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.200420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.200660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.200798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.200952] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.377991] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 988.378364] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 988.378580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.669025] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.669025] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.669025] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.669781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.669781] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.669781] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.669922] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.669922] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.670082] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.670221] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.670385] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.694374] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.694597] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.694760] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.695131] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-867" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.695368] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.695617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.695664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.696088] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.696220] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88fa8c96-e1f4-47fa-8a33-054fdc26a1a4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.705540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.705684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.705776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.706306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.707273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.707688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.707688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.707688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.707924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.707924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.708042] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 988.735920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.736109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.736184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.736403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.736550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.747740] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 989.199267] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.199593] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.199672] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.200068] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.200285] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.200456] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 not found, creating... [ 989.200767] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.200949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.201139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.201378] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.201556] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.201874] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.202106] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.202244] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.202545] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.202711] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.202871] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 is going to be created. [ 989.223750] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.225410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.225410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.225410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.225410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.225410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.938426] env[65119]: INFO networking_nsxv3.common.synchronization [req-84ff0576-e798-4e98-83c8-44ac56d25f42 req-73894ad9-db65-40f2-b785-ed8c783be2a2 service nova] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 989.938647] env[65119]: INFO networking_nsxv3.common.synchronization [req-84ff0576-e798-4e98-83c8-44ac56d25f42 req-73894ad9-db65-40f2-b785-ed8c783be2a2 service nova] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 989.938792] env[65119]: INFO networking_nsxv3.common.synchronization [req-84ff0576-e798-4e98-83c8-44ac56d25f42 req-73894ad9-db65-40f2-b785-ed8c783be2a2 service nova] Enqueued Resource ID: 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 with Priority: HIGHEST for action port [ 989.939350] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_rules [ 989.939517] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 989.939585] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 with Priority: HIGHEST for action port [ 989.940058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.940214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.940318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.940485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.940569] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.941553] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.941649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.941853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.941951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.942030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.942201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.942315] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88fa8c96-e1f4-47fa-8a33-054fdc26a1a4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.445143] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.445428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.445530] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 with status ACTIVE [ 990.445621] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.445731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.445807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.446248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.446397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.446614] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.446747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.446814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.446976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.447136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.447335] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.447432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.447495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.447643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.447717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.447800] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88fa8c96-e1f4-47fa-8a33-054fdc26a1a4 is going to be updated. [ 990.469228] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.469307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.469339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.469570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.470177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.470177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88fa8c96-e1f4-47fa-8a33-054fdc26a1a4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.759839] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 990.760096] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 deletion is rescheduled due to dependency. [ 990.760209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.760848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.761211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.761514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.761988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.762598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.762598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.762598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.762702] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.940468] env[65119]: INFO networking_nsxv3.common.synchronization [None req-eaccc20e-94c3-4440-a377-9adb2ed82251 None None] Enqueued Resource ID: 60cf1a60-b892-4f5e-b70b-0070b763b79c with Priority: HIGHEST for action port [ 990.940468] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60cf1a60-b892-4f5e-b70b-0070b763b79c with Priority: HIGHEST for action port [ 990.940468] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-60cf1a60-b892-4f5e-b70b-0070b763b79c taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.940468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60cf1a60-b892-4f5e-b70b-0070b763b79c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.940468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60cf1a60-b892-4f5e-b70b-0070b763b79c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.940921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60cf1a60-b892-4f5e-b70b-0070b763b79c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.940921] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60cf1a60-b892-4f5e-b70b-0070b763b79c',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.266882] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.444784] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60cf1a60-b892-4f5e-b70b-0070b763b79c [ 991.445059] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.445222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.445460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.445498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.445764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.445764] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60cf1a60-b892-4f5e-b70b-0070b763b79c already deleted. [ 991.445877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60cf1a60-b892-4f5e-b70b-0070b763b79c" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.771667] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.274806] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.275132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.275218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.275541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.275794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.275879] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 992.316265] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.316483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.316564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.316742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.316904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.329459] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 992.583710] env[65119]: INFO networking_nsxv3.common.synchronization [req-91c2ebcb-0e39-45e1-8af7-ccfa8159765c req-76e08a51-f77d-4706-8e3f-f9a6024541b6 tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 992.584287] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 992.584858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.584858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.584858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.587886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.588186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.588267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.588336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.588566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.588677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.588843] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.971064] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.971297] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.971444] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.971796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.972121] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.972313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.972432] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.972658] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.972869] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.973136] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.973319] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.973459] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.973594] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.973711] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.973901] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.974147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.995794] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.996102] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.996272] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.996451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-468" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.996774] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-1f7995ef-05ae-4ad4-9319-734e290cc808 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.996969] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.997197] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.997607] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.997776] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7995ef-05ae-4ad4-9319-734e290cc808',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.091965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.092683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.092683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.092683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.092683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.092880] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.092880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.092880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.092993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.093149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.093208] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 already deleted. [ 993.093265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.223816] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c45aa3e5-e14a-461e-893f-eb5b52d6df7a None None] Enqueued Resource ID: 239c47fc-7cfd-452d-a05a-dd7098df0a90 with Priority: HIGHEST for action port [ 993.224413] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 239c47fc-7cfd-452d-a05a-dd7098df0a90 with Priority: HIGHEST for action port [ 993.224842] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-239c47fc-7cfd-452d-a05a-dd7098df0a90 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.225315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-239c47fc-7cfd-452d-a05a-dd7098df0a90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.225467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-239c47fc-7cfd-452d-a05a-dd7098df0a90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.226216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-239c47fc-7cfd-452d-a05a-dd7098df0a90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.226216] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('239c47fc-7cfd-452d-a05a-dd7098df0a90',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.503285] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.503285] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.503517] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.503651] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.503796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.503993] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 1f7995ef-05ae-4ad4-9319-734e290cc808 not found, creating... [ 993.504394] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.504586] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.504711] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.504966] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.505141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.505437] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.505592] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.505710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.505940] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.507203] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.507452] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 1f7995ef-05ae-4ad4-9319-734e290cc808 is going to be created. [ 993.534049] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.534049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.534049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.534049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.534049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.534049] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.727895] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 239c47fc-7cfd-452d-a05a-dd7098df0a90 [ 993.728262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.728378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.728460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.728697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.728810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.728933] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:239c47fc-7cfd-452d-a05a-dd7098df0a90 already deleted. [ 993.729069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-239c47fc-7cfd-452d-a05a-dd7098df0a90" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.281102] env[65119]: INFO networking_nsxv3.common.synchronization [req-91c2ebcb-0e39-45e1-8af7-ccfa8159765c req-de330d11-379a-4650-a3b5-cb1e69ca99cd service nova] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 994.281310] env[65119]: INFO networking_nsxv3.common.synchronization [req-91c2ebcb-0e39-45e1-8af7-ccfa8159765c req-de330d11-379a-4650-a3b5-cb1e69ca99cd service nova] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 994.284448] env[65119]: INFO networking_nsxv3.common.synchronization [req-91c2ebcb-0e39-45e1-8af7-ccfa8159765c req-de330d11-379a-4650-a3b5-cb1e69ca99cd service nova] Enqueued Resource ID: 1f7995ef-05ae-4ad4-9319-734e290cc808 with Priority: HIGHEST for action port [ 994.284986] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_rules [ 994.285183] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 994.285294] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7995ef-05ae-4ad4-9319-734e290cc808 with Priority: HIGHEST for action port [ 994.286178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.286309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.286440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286744] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.287673] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.287770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.287882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.291037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.291037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.291037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.291037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.291271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.291375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.291718] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.292582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f7995ef-05ae-4ad4-9319-734e290cc808 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.292701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.292772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.292945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.293030] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7995ef-05ae-4ad4-9319-734e290cc808',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.342909] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 994.342909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.342909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.342909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.342909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.342909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.343216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.343216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.343216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.343582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.343582] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.795231] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.795546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.797774] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.798728] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f7995ef-05ae-4ad4-9319-734e290cc808 with status ACTIVE [ 994.799103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.799201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.799290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.799544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.799640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.799855] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.799982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.800336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.800336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.800415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.800572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.800697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.800770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.801322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.801429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.801523] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f7995ef-05ae-4ad4-9319-734e290cc808 is going to be updated. [ 994.827476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.827707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.827780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.828010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.828121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.828286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f7995ef-05ae-4ad4-9319-734e290cc808" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.845149] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.303379] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.348091] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf1fd06-b056-4d16-b440-25af92d62920: rpc.has_security_group_logging(os_id): False [ 995.370993] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.371175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.371214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.372238] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.372238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.372238] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 995.446664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.446926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.446926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.447102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.447387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.464683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 995.806573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.807161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.807161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.807255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.807354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.807472] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 is going to be created. [ 995.834998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.834998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.834998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.834998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.834998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.848270] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: UNINITIALIZED for 2s [ 997.062956] env[65119]: INFO networking_nsxv3.common.synchronization [None req-2283c48f-b3a9-4d18-a3c1-53fdb5b71cbe tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 997.063402] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 997.063716] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.063876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.063935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.064217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.064330] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.162101] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9c1d5151-008b-43c7-85a4-62a1a6df1a7c tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 997.162746] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 997.163098] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.163204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.480353] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 997.480598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.588497] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.588763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.588763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.588929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.589088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.589286] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff already deleted. [ 997.589286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.590541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.590541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.590541] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.862096] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: SUCCESS [ 997.862096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.862553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.862553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.862743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.862855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.862908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.863746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.863746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.863746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.863746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.117831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.118343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.118343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.118343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.118510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.118510] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff already deleted. [ 998.118571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.365280] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.868248] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cac32beb-4c24-4e53-9268-c02bfdb859d7: rpc.has_security_group_logging(os_id): False [ 998.887868] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.888051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.888166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.888310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.888422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.888671] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.888797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.888875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.889056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.889140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.889255] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 is going to be created. [ 998.948816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.949015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.949105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.949342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.949557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.961672] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: IN_PROGRESS for 2s [ 1000.975889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: SUCCESS [ 1000.975889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.164189] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.164502] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1002.908825] env[65119]: INFO networking_nsxv3.common.synchronization [req-7f0d5d44-ddb7-454b-9c06-578f8929af98 req-58b7b142-2dec-497f-bb2d-a228a0f98465 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1002.909416] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1002.909788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.909941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.909992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.910264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.910429] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.910600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.910681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.910867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.910958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.911065] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.216144] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.216472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.216472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.216914] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.217196] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.217357] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.217473] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.217781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.217932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.218157] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.218272] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.218403] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.218513] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.218624] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.218728] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.218865] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.238930] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.239132] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.239528] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.239528] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.239772] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-19c0e8ae-abdf-415b-8316-27466545fdbd taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.239988] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.240134] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.240611] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.240611] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c0e8ae-abdf-415b-8316-27466545fdbd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.412966] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.743747] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.743928] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.744063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.744357] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.744542] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.744674] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 19c0e8ae-abdf-415b-8316-27466545fdbd not found, creating... [ 1003.745211] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.745387] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.745471] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.745731] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.745874] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.746208] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746370] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746517] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746772] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.747044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.747044] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 19c0e8ae-abdf-415b-8316-27466545fdbd is going to be created. [ 1003.771730] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.771959] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.772086] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.772373] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.772600] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.772827] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.915765] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.422561] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.422561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.422561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.422561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.422561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.422561] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1004.457092] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.457092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.457304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.457483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.457648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.467436] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1004.532225] env[65119]: INFO networking_nsxv3.common.synchronization [req-7f0d5d44-ddb7-454b-9c06-578f8929af98 req-49afddfa-2bb2-4ab6-a5c3-59a0951001c0 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1004.532537] env[65119]: INFO networking_nsxv3.common.synchronization [req-7f0d5d44-ddb7-454b-9c06-578f8929af98 req-49afddfa-2bb2-4ab6-a5c3-59a0951001c0 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1004.532741] env[65119]: INFO networking_nsxv3.common.synchronization [req-7f0d5d44-ddb7-454b-9c06-578f8929af98 req-49afddfa-2bb2-4ab6-a5c3-59a0951001c0 service nova] Enqueued Resource ID: 19c0e8ae-abdf-415b-8316-27466545fdbd with Priority: HIGHEST for action port [ 1004.533495] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1004.533680] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1004.533847] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c0e8ae-abdf-415b-8316-27466545fdbd with Priority: HIGHEST for action port [ 1004.534512] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.534512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.534975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.534975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.534975] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.537800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.537800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.537800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-19c0e8ae-abdf-415b-8316-27466545fdbd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.537800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.537800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.537800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.537800] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c0e8ae-abdf-415b-8316-27466545fdbd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.040038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.040203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.040469] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19c0e8ae-abdf-415b-8316-27466545fdbd with status ACTIVE [ 1005.040694] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.040854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.040978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.041105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.041197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.041373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.041479] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.041549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.041963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.041963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.041963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.042259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.042259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.042529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.042665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.042807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19c0e8ae-abdf-415b-8316-27466545fdbd is going to be updated. [ 1005.071453] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.071453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.071453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.071453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.071453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.071453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19c0e8ae-abdf-415b-8316-27466545fdbd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.398795] env[65119]: INFO networking_nsxv3.common.synchronization [req-13478719-9fb3-4617-8833-6d07f3115c65 req-09f2a2f2-e9f5-4e02-ba09-c2f522b6dbc6 tempest-InstanceActionsTestJSON-746616076 tempest-InstanceActionsTestJSON-746616076-project-member] Enqueued Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1005.398891] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1005.399189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.399316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.399383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.399692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.399886] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.399995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.400070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.400226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.400312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.400409] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.830625] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.831138] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.831138] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.831499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.832955] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.833208] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.833438] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.833622] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.833836] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.834131] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.834241] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.834378] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.834484] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.834644] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.834727] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.834808] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.857971] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.858182] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.858342] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.858527] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-562" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.858894] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-0261327e-9e8e-455f-9744-b1eb7e40d12e taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.859105] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.859218] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.859592] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.859803] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0261327e-9e8e-455f-9744-b1eb7e40d12e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.903346] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.903346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.903346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.903346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.903346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.903891] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.903891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.903891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.903891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.904152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.904152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f already deleted. [ 1005.904152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.363604] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.363838] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.364165] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.364526] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.364693] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.364862] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 0261327e-9e8e-455f-9744-b1eb7e40d12e not found, creating... [ 1006.365183] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.365362] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.365482] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.365729] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.365870] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.366256] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.366426] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.366547] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.366775] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.366910] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.367072] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 0261327e-9e8e-455f-9744-b1eb7e40d12e is going to be created. [ 1006.387755] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.387957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.388108] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.388387] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.388616] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.388841] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.481889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1006.482129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.482302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.482518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.482704] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.482825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.482893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.483053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.483210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.483297] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.985417] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.068654] env[65119]: INFO networking_nsxv3.common.synchronization [req-13478719-9fb3-4617-8833-6d07f3115c65 req-09e4262b-562f-4377-bebb-fe5dece78fbf service nova] Enqueued Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_rules [ 1007.068838] env[65119]: INFO networking_nsxv3.common.synchronization [req-13478719-9fb3-4617-8833-6d07f3115c65 req-09e4262b-562f-4377-bebb-fe5dece78fbf service nova] Enqueued Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1007.068999] env[65119]: INFO networking_nsxv3.common.synchronization [req-13478719-9fb3-4617-8833-6d07f3115c65 req-09e4262b-562f-4377-bebb-fe5dece78fbf service nova] Enqueued Resource ID: 0261327e-9e8e-455f-9744-b1eb7e40d12e with Priority: HIGHEST for action port [ 1007.069709] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_rules [ 1007.070045] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1007.070174] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0261327e-9e8e-455f-9744-b1eb7e40d12e with Priority: HIGHEST for action port [ 1007.070458] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.070580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.070644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.070901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.070994] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.072511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.072636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.072703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.072877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.073040] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.073166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.073244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.073339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.073424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.073499] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.074267] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0261327e-9e8e-455f-9744-b1eb7e40d12e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.074437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.074437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.074781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.074865] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0261327e-9e8e-455f-9744-b1eb7e40d12e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.487770] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.576412] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.577501] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.577685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.577787] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0261327e-9e8e-455f-9744-b1eb7e40d12e with status ACTIVE [ 1007.577947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.578575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.578575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.578575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.578575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.578575] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.578888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.578888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.578888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.578888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.579079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.579172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.579231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.579364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.579436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.579515] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0261327e-9e8e-455f-9744-b1eb7e40d12e is going to be updated. [ 1007.604335] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.604335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.604335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.604527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.604646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.604806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0261327e-9e8e-455f-9744-b1eb7e40d12e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.990538] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.991032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.991032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.991161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.991161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.991290] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1008.025444] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.025630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.025687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.025883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.026047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.034785] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1008.082336] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.585039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.585266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.585266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.585674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.585802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.585913] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f is going to be created. [ 1008.622813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.623056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.623127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.623309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.623483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.633288] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: UNINITIALIZED for 2s [ 1010.043829] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1010.044221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.044221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.044360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.044552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.044666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.044724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.044871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.044952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.045074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.045215] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.549511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.549511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.549511] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.549511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.550912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.550912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.551097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.551209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.551272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.551427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.551510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.551598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.551689] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.645154] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: SUCCESS [ 1010.645154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.645264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.645448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.645649] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.645764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.645830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.645978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.646075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.646159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.646249] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.055154] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1011.077998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.078253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.078308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.078557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.078674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.078968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.079097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.079180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.079392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.079477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.079723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.079863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.079928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.080683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.080851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.081045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.081205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.081304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.081466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.081576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.081709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1011.149064] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.149331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.149331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.149853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.149853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.149853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.149853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.150150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.150150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.150291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.150368] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.150460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.150520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.150661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.150809] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.151054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.151227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.151414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.151506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.151614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.151721] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.155944] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.156089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.156146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.156302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.156437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.170157] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1011.484693] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1011.484911] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:2 started [ 1011.654543] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27a5e149-5084-473e-990e-2dfe2bf8717f: rpc.has_security_group_logging(os_id): False [ 1011.673841] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.674074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.674074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.674235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.674560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.674792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.674904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.674968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.675157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.675242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.675430] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.675576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.675636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.675733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.675809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.676026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.676111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.676171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.676312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.676387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.676495] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f is going to be created. [ 1011.742546] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.742695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.742767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.742983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.743186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.755702] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: IN_PROGRESS for 2s [ 1012.071899] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1012.071899] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1012.888833] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3268bbb-8120-465f-aa70-c2d24a8c338a req-2ccba14c-bc05-468f-9af7-518e7c2ace9c tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1012.889053] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1012.889348] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.889544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.889622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.889908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.890232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.890232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.890232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.890457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.890539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.890635] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.186649] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1013.186649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.216463] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.216633] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.216761] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.217048] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.217315] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.217476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.217758] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.217840] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.217956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.218191] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.218304] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.218411] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.218516] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.218722] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.218722] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.218850] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.238767] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.238935] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.239112] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.239266] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.239587] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.239821] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.239971] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.240325] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.240465] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f7d05e-2bcc-45b3-b821-6b2c7f7a14be',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.393634] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.393791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.393864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.394352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.394492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.394714] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.394785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.394854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.395046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.395122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.395196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 already deleted. [ 1013.395287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.743087] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.743087] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.743347] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.743492] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.743644] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.743841] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be not found, creating... [ 1013.744068] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.744235] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.744353] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.744580] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.744718] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.744996] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.745169] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.745319] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.745501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.745632] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.745773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be is going to be created. [ 1013.771785] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.772088] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.772368] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.772538] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.772814] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.773099] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.774749] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: SUCCESS [ 1013.774942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3268bbb-8120-465f-aa70-c2d24a8c338a req-6f9c5956-17eb-4363-8d35-06ffe3be264a service nova] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_rules [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3268bbb-8120-465f-aa70-c2d24a8c338a req-6f9c5956-17eb-4363-8d35-06ffe3be264a service nova] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [req-e3268bbb-8120-465f-aa70-c2d24a8c338a req-6f9c5956-17eb-4363-8d35-06ffe3be264a service nova] Enqueued Resource ID: 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be with Priority: HIGHEST for action port [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_rules [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1014.495210] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be with Priority: HIGHEST for action port [ 1014.496371] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.496670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.496836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.497195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.497558] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.498898] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.499165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.499318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.499572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.500016] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.500701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.500701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.500701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.500701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.500701] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.502633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.502776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.502823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.502968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.503067] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f7d05e-2bcc-45b3-b821-6b2c7f7a14be',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.005035] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.006060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.006236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.006700] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be with status ACTIVE [ 1015.006940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.007117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.007551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.007551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.007720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.007870] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.008038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.008121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.008351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.008471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.008769] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.008915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.008976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.009181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.009296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.009420] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74f7d05e-2bcc-45b3-b821-6b2c7f7a14be is going to be updated. [ 1015.035520] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.035722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.035722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.035963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.036161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.036376] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74f7d05e-2bcc-45b3-b821-6b2c7f7a14be" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.371337] env[65119]: INFO networking_nsxv3.common.synchronization [req-d32e885e-1eb0-4b1c-8082-bcab039d0da4 req-0defe87a-addd-40d9-a67e-65306c92d7d6 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1015.371923] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1015.372225] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.372653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.372653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.372735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.372820] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.372961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.373035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.373144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.373228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.373329] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.507626] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.734969] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.735259] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.735418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.735684] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.735938] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.736118] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.736237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.736460] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.736600] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.736853] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.736985] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.737114] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.737229] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.737394] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.737522] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.737673] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.757599] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.757842] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.758095] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.758409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.758927] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-e2c62c4d-d916-40fb-9ee0-e08349919821 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.759244] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.759471] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.760023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.760269] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2c62c4d-d916-40fb-9ee0-e08349919821',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.875675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.875858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.875936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.876173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.876262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.876456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.876592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.876634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.876762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.876829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.876915] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff already deleted. [ 1015.876995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.010087] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.010273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.010339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.010933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.011057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.011164] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be created. [ 1016.039035] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.039035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.039035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.039035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.039035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.048850] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: UNINITIALIZED for 2s [ 1016.263063] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.263063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.263063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.263063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.263336] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.263336] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port e2c62c4d-d916-40fb-9ee0-e08349919821 not found, creating... [ 1016.263570] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.263731] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.263887] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.264091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.264235] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.264519] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.264683] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.264793] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.265017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.265173] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.265337] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: e2c62c4d-d916-40fb-9ee0-e08349919821 is going to be created. [ 1016.290949] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.291179] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.291322] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.291629] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.291859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.292098] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.653265] env[65119]: INFO networking_nsxv3.common.synchronization [req-07006974-16e3-4d4a-8f91-40ae0f693fa2 req-ca556102-6a2d-4934-bbe8-c0486b8e4330 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1016.654061] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1016.654437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.654564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.654630] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.654827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.654972] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.655083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.655141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.655288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.655371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.655467] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.052408] env[65119]: INFO networking_nsxv3.common.synchronization [req-d32e885e-1eb0-4b1c-8082-bcab039d0da4 req-98a2ed37-67b4-47bc-8722-98ff0055345e service nova] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 1017.053118] env[65119]: INFO networking_nsxv3.common.synchronization [req-d32e885e-1eb0-4b1c-8082-bcab039d0da4 req-98a2ed37-67b4-47bc-8722-98ff0055345e service nova] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1017.053323] env[65119]: INFO networking_nsxv3.common.synchronization [req-d32e885e-1eb0-4b1c-8082-bcab039d0da4 req-98a2ed37-67b4-47bc-8722-98ff0055345e service nova] Enqueued Resource ID: e2c62c4d-d916-40fb-9ee0-e08349919821 with Priority: HIGHEST for action port [ 1017.054143] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_rules [ 1017.054321] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1017.054452] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c62c4d-d916-40fb-9ee0-e08349919821 with Priority: HIGHEST for action port [ 1017.054750] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.054911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.055041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.058233] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.058233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.058233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.058233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.058648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.060107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.060107] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.062088] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2c62c4d-d916-40fb-9ee0-e08349919821 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.062088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.062088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.062088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.062088] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2c62c4d-d916-40fb-9ee0-e08349919821',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.158160] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.558437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.559152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.569441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.573391] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2c62c4d-d916-40fb-9ee0-e08349919821 with status ACTIVE [ 1017.573391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.573391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.573391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.576031] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.576031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.576031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.576268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.576268] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.577716] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2c62c4d-d916-40fb-9ee0-e08349919821 is going to be updated. [ 1017.606569] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.606747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.606797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.606987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.607149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.607359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2c62c4d-d916-40fb-9ee0-e08349919821" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.660277] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.898900] env[65119]: INFO networking_nsxv3.common.synchronization [req-814086f4-e5a3-4ada-94ab-f4afee8b5b9d req-48fd0869-7993-4a29-b3ba-9672578d5842 tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1017.899482] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1017.899786] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.899930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.900032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.900260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.900395] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.900620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.900620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.900754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.900927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.900927] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.058928] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1018.059207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.059391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.059556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.059752] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.059930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.060035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.060181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.060256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.060342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.060434] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.079021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.162589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.162789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.162934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.163183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.163277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.163378] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1018.199451] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.199580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.199580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.199790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.199973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.211659] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1018.267996] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.268156] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.268156] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.268437] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.268860] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.269026] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.269176] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.269406] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.269552] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.269847] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.270037] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.270152] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.270259] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.270386] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.270500] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.270634] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.291263] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.291431] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.291627] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.292505] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-130" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.292809] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-52e67203-42ad-4b49-934c-cf95702835f1 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.293017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.293144] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.293503] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.293663] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e67203-42ad-4b49-934c-cf95702835f1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.403173] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.403369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.403369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.403962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.404215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.404586] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.404716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.404785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.405018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.405122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.405228] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 1018.447025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.447025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.447025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.447025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.447025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.456502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 1018.563687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.563858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.563940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.564175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.564388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.564499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.564570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.564730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.564826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.564958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.565248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.565248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.565383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.565431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.565586] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.565760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.565760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.565880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.565954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.566087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.566136] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.581020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.581252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.581308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.581578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.581747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.581863] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff is going to be created. [ 1018.609051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.609259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.609350] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.609765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.609850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.624508] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: UNINITIALIZED for 2s [ 1018.797166] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.798132] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.798282] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.798648] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.798840] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.799047] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 52e67203-42ad-4b49-934c-cf95702835f1 not found, creating... [ 1018.799407] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.799621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.799802] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.800101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.800287] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.800603] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.800765] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.800943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.801211] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.801385] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.801559] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 52e67203-42ad-4b49-934c-cf95702835f1 is going to be created. [ 1018.836683] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.836921] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.836965] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.837438] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.837723] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.838134] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.068394] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15784b52-ff73-4fa3-a18b-f8082c6f3c89: rpc.has_security_group_logging(os_id): False [ 1019.095048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.095048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.095474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.095682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.095849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.096307] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.096422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.096460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.096703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.096812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.097132] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.097547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.097547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.097547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.097710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.097906] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.098205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.098387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.098485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.098584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.098709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be created. [ 1019.184042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.184042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.184042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.184042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.184042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.206938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1019.530639] env[65119]: INFO networking_nsxv3.common.synchronization [req-814086f4-e5a3-4ada-94ab-f4afee8b5b9d req-1d6c88db-cead-48e9-8021-7bee25dfcbfe service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 1019.530639] env[65119]: INFO networking_nsxv3.common.synchronization [req-814086f4-e5a3-4ada-94ab-f4afee8b5b9d req-1d6c88db-cead-48e9-8021-7bee25dfcbfe service nova] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1019.531272] env[65119]: INFO networking_nsxv3.common.synchronization [req-814086f4-e5a3-4ada-94ab-f4afee8b5b9d req-1d6c88db-cead-48e9-8021-7bee25dfcbfe service nova] Enqueued Resource ID: 52e67203-42ad-4b49-934c-cf95702835f1 with Priority: HIGHEST for action port [ 1019.531533] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_rules [ 1019.531735] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1019.531820] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52e67203-42ad-4b49-934c-cf95702835f1 with Priority: HIGHEST for action port [ 1019.532132] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.532666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.532666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.532882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.532990] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.533962] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.534083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.534336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-52e67203-42ad-4b49-934c-cf95702835f1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.534474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.534518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.535225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.535225] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e67203-42ad-4b49-934c-cf95702835f1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.038492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.038877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.038877] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52e67203-42ad-4b49-934c-cf95702835f1 with status ACTIVE [ 1020.038958] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.039238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.039238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.039348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.039396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.039553] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.039762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.039879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.040144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.040230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.041056] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.041056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.041056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.041056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.041056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.041056] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52e67203-42ad-4b49-934c-cf95702835f1 is going to be updated. [ 1020.062639] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.062847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.062954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.063387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.063542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.063701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52e67203-42ad-4b49-934c-cf95702835f1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.226942] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1020.226942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.388317] env[65119]: INFO networking_nsxv3.common.synchronization [req-3a603287-4be5-4d6f-bd9f-a5a394f9d6b6 req-99bc0578-77ee-40e7-81d6-cc2e384e5ec8 tempest-ServerRescueTestJSON-755354593 tempest-ServerRescueTestJSON-755354593-project-member] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1020.389034] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1020.390878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.391253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.393075] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.393075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.393075] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.468875] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 1020.469201] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d deletion is rescheduled due to dependency. [ 1020.469380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.469642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.470089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.471523] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.471523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.471523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.471523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.471523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.471795] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.636931] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: SUCCESS [ 1020.637396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.637565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.637865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.638130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.638291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.638355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.638514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.638594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.638679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.638768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.794367] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.794562] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.794687] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.794956] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.795674] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.795674] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.795847] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.795971] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.796212] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.796462] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.796590] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.796740] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.797323] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.797578] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.797578] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.798203] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.818103] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.818330] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.818490] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.818676] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-556" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.819041] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-3159a72b-f7fb-4c12-9575-aaa1f533bf91 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.819213] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.819349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.819712] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.819853] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3159a72b-f7fb-4c12-9575-aaa1f533bf91',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.895354] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.977317] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.141430] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.222277] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1021.222548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.322820] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.322820] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.323116] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.323367] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.323592] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.323814] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 3159a72b-f7fb-4c12-9575-aaa1f533bf91 not found, creating... [ 1021.324241] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.324519] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.324709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.325037] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.325355] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.325674] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.325908] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.326114] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.326422] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.326617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.326841] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 3159a72b-f7fb-4c12-9575-aaa1f533bf91 is going to be created. [ 1021.349623] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.350079] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.350183] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.350623] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.351164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.351333] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.399071] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.479080] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.643547] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5a2a36a-9776-4e8f-af73-6d8b077adfff: rpc.has_security_group_logging(os_id): False [ 1021.667743] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.668783] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.668783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.669314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.669314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.669314] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff is going to be created. [ 1021.754196] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.755323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.755323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.755323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.755323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.770679] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: IN_PROGRESS for 2s [ 1021.901666] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.901949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.901949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.902864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.903169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.903333] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be updated. [ 1021.942333] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.942620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.942620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.942776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.942925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.955992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 1021.984154] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.984154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.984154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.984463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.984673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.984801] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 1022.028503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.028911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.028911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.029119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.029230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.047656] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 1022.172076] env[65119]: INFO networking_nsxv3.common.synchronization [req-3a603287-4be5-4d6f-bd9f-a5a394f9d6b6 req-a7645c55-8602-40e7-8c7d-f5d1fe759b39 service nova] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_rules [ 1022.172576] env[65119]: INFO networking_nsxv3.common.synchronization [req-3a603287-4be5-4d6f-bd9f-a5a394f9d6b6 req-a7645c55-8602-40e7-8c7d-f5d1fe759b39 service nova] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1022.172849] env[65119]: INFO networking_nsxv3.common.synchronization [req-3a603287-4be5-4d6f-bd9f-a5a394f9d6b6 req-a7645c55-8602-40e7-8c7d-f5d1fe759b39 service nova] Enqueued Resource ID: 3159a72b-f7fb-4c12-9575-aaa1f533bf91 with Priority: HIGHEST for action port [ 1022.173788] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_rules [ 1022.173893] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1022.174062] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3159a72b-f7fb-4c12-9575-aaa1f533bf91 with Priority: HIGHEST for action port [ 1022.174369] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.174501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.174588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.174798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.175350] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.179024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.179024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.179024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-3159a72b-f7fb-4c12-9575-aaa1f533bf91 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.179024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.179024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.179024] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.179024] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3159a72b-f7fb-4c12-9575-aaa1f533bf91',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.682880] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.683097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.684487] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3159a72b-f7fb-4c12-9575-aaa1f533bf91 with status ACTIVE [ 1022.684766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.684918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.684996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.685279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.685370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.685555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.685667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.685739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.685895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.685972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.686166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.686255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.686352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.686451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.686525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.686610] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3159a72b-f7fb-4c12-9575-aaa1f533bf91 is going to be updated. [ 1022.711831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.712063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.712174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.712900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.712900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.713033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3159a72b-f7fb-4c12-9575-aaa1f533bf91" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.784249] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: SUCCESS [ 1023.784750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.967516] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 1023.967933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.968214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.968507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.968715] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.968836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.968904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.969083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.969160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.969289] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.057680] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.058977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.058977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.059378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.059378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.059378] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.124587] env[65119]: INFO networking_nsxv3.common.synchronization [req-843e2fc9-5ade-40f4-973c-9300eb70de78 req-b9cf52d3-71ae-4eb1-8f7b-179bade658c4 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1024.125156] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1024.125470] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.125612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.125676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.125877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.126442] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.126627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.126716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.126877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.126999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.127152] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.472521] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.532804] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.533270] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.533544] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.533936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.534340] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.534692] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.534947] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.535346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.535597] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.536020] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.536301] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.536532] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.536719] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.536970] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.537267] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.537549] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.562593] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.562958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.562958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.563203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.563429] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.563580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.563659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.563938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.564141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.564213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.564424] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.564575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.564662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.564850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.565032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.565166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.565245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.565418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.565524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.565619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.565716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.567755] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.567970] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.568186] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.568468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.568782] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-243255a2-c045-47b1-ae3f-4cc508b2a83d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.568961] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.569124] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.569548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.569693] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('243255a2-c045-47b1-ae3f-4cc508b2a83d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.630497] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.630825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.630825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.631124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.631228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.631478] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.631739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.631739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.631907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.631946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.632057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1024.663286] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.663594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.663594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.663919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.664163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.674480] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1024.748497] env[65119]: INFO networking_nsxv3.common.synchronization [req-b39e1ea0-7409-4166-a56e-ea4dd2816a48 req-0b114ddf-f6b7-48a8-a113-80f65884337e tempest-InstanceActionsTestJSON-746616076 tempest-InstanceActionsTestJSON-746616076-project-member] Enqueued Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1024.749160] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGHEST for action security_group_members [ 1024.749526] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.749645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.749742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.750039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.750191] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.750346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.750447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.750629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.750745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.750882] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.975837] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.071465] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a698aa11-3871-4c02-b0a5-985be0e71f6d: rpc.has_security_group_logging(os_id): False [ 1025.073161] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073453] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.073638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.073949] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.074205] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.074398] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 243255a2-c045-47b1-ae3f-4cc508b2a83d not found, creating... [ 1025.074698] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.074900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.075051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.075320] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.075487] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.075849] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.075981] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.076145] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.076390] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.076554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.076724] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 243255a2-c045-47b1-ae3f-4cc508b2a83d is going to be created. [ 1025.096448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.096608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.096665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.096886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.096954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.097150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.100569] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.100569] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.100569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.100569] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 1025.101586] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.101764] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.101890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.102129] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.102389] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.102554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.196113] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.196324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.196324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.196622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.196925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.224974] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 1025.253545] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.253763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.253763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.253992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.254136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.254296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.254405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.254465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.254643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.254746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.254840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f is going to be updated. [ 1025.303106] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.303106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.303106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.303106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.303106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.319873] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: IN_PROGRESS for 2s [ 1025.478459] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.478459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.478459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.478459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.478689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.478925] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be updated. [ 1025.509164] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.509801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.509877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.510738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.510738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.521419] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 1025.853091] env[65119]: INFO networking_nsxv3.common.synchronization [req-843e2fc9-5ade-40f4-973c-9300eb70de78 req-2cb4ec25-1abe-4236-8f35-0fa67d323993 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 1025.853091] env[65119]: INFO networking_nsxv3.common.synchronization [req-843e2fc9-5ade-40f4-973c-9300eb70de78 req-2cb4ec25-1abe-4236-8f35-0fa67d323993 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1025.853091] env[65119]: INFO networking_nsxv3.common.synchronization [req-843e2fc9-5ade-40f4-973c-9300eb70de78 req-2cb4ec25-1abe-4236-8f35-0fa67d323993 service nova] Enqueued Resource ID: 243255a2-c045-47b1-ae3f-4cc508b2a83d with Priority: HIGHEST for action port [ 1025.853614] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 1025.853710] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1025.853746] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 243255a2-c045-47b1-ae3f-4cc508b2a83d with Priority: HIGHEST for action port [ 1025.854319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.854542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.854621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.854850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.854974] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.856849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.857033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.857293] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-243255a2-c045-47b1-ae3f-4cc508b2a83d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.857440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.857534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.857763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.857877] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('243255a2-c045-47b1-ae3f-4cc508b2a83d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.107362] env[65119]: INFO networking_nsxv3.common.synchronization [req-82dd118d-bfe5-4fd8-ba25-5cc69f1f4043 req-f8d49521-fce3-400a-a8a0-b2f40bfa4c4e tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 1026.109180] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGHEST for action security_group_members [ 1026.109180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.109180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.109180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.109180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.109610] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.109991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.109991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.110192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.110320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.110434] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.358170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.358170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.362594] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 243255a2-c045-47b1-ae3f-4cc508b2a83d with status ACTIVE [ 1026.362594] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.362703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.363355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.363355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.363355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.363355] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.363856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.363856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.363856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.363856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.364108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.364244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.364327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.364535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.364663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.365639] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 243255a2-c045-47b1-ae3f-4cc508b2a83d is going to be updated. [ 1026.391952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.392147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.392200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.392439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.392558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.392749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-243255a2-c045-47b1-ae3f-4cc508b2a83d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.613818] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.613993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.614144] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.614467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.615522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.615522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.615522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.615522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.615522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.615522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.615522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 is going to be updated. [ 1026.646508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.646700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.646767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.647109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.647275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.665602] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: IN_PROGRESS for 2s [ 1026.686231] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1026.686231] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 1026.686480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.687321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.687578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.687846] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.687962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.688103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.688331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.688483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.688483] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.196904] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.242051] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 1027.242354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.330602] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a5e149-5084-473e-990e-2dfe2bf8717f in Status: SUCCESS [ 1027.330865] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f deletion is rescheduled due to dependency. [ 1027.331040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.531688] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 1027.531922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.532117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.532510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.532731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.532859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.532915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.533175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.533314] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.533516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.533596] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.695649] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.036623] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.037681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.037681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.037681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.038998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.038998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.038998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.038998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.038998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.038998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.039590] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.039590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.039590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.039801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.039978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.040191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.040279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.040457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.040560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.040739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.040796] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.198363] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.198817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.198817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.198996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.199090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.199198] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1028.232481] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.232691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.232691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.232895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.233087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.243596] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1028.543648] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77b26c46-fbab-436a-bd4d-c5014107aa41: rpc.has_security_group_logging(os_id): False [ 1028.566920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.567178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.567178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.567442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.567614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.567896] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.568048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.568162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.568426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.568503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.568781] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.568912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.568992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.569279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.569388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.569617] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.569732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.569851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.570101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.570217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.570336] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be updated. [ 1028.659109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.659862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.659862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.660640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.660922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.676962] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 1028.677762] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 in Status: SUCCESS [ 1028.677868] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 deletion is rescheduled due to dependency. [ 1028.677976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.259570] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1030.259942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.259942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.260301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.260784] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.260784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.260784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.260973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.260973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.261794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.261794] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.690581] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 1030.690772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.763905] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.763905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.763905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.764123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.765049] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.765049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.765049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.765049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.765049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.765049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.765587] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.765587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.765665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.765830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.766119] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.766250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.766418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.766597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.766689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.766839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.767013] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.109178] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1031.109336] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1031.271550] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 1031.289796] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.289950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.290045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.290340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.290435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.290652] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.290754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.290818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.290963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.291120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.291368] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.291465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.291527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.291665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.291737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.291918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.292022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.292320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.292498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.292622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.292737] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1031.358232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.358327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.358327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.358518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.358665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.374848] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1031.709675] env[65119]: INFO networking_nsxv3.common.synchronization [req-a7965e8d-f231-4f6d-a05d-45e2335e0afb req-da7c11ca-24e6-4856-8306-5f98db320cc7 tempest-ImagesOneServerNegativeTestJSON-51367032 tempest-ImagesOneServerNegativeTestJSON-51367032-project-member] Enqueued Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1031.710060] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a698aa11-3871-4c02-b0a5-985be0e71f6d with Priority: HIGHEST for action security_group_members [ 1031.710446] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-a698aa11-3871-4c02-b0a5-985be0e71f6d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.710691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.710691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.711515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.711515] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.711515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.711515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.711515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.711515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.711515] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a698aa11-3871-4c02-b0a5-985be0e71f6d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.213827] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.214054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.214148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.214400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.214526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.214736] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.214841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.214903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.215085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.215193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.215238] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d is going to be updated. [ 1032.260373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.260835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.260835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.260835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.260981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.273593] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: IN_PROGRESS for 2s [ 1033.394381] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1033.394381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.440034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.440034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.440034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.440034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.440034] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.851028] env[65119]: INFO networking_nsxv3.common.synchronization [req-d9e8398f-877b-4bfc-ba05-fddfaf6dd15b req-d7ad4ed3-2c16-4d29-8f47-e53628943698 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1033.851028] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1033.851028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.851028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.851028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.851028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.851028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.851447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.851447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.851447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.851563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.851563] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.946442] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.283696] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a698aa11-3871-4c02-b0a5-985be0e71f6d in Status: SUCCESS [ 1034.283969] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a698aa11-3871-4c02-b0a5-985be0e71f6d deletion is rescheduled due to dependency. [ 1034.284263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a698aa11-3871-4c02-b0a5-985be0e71f6d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.355555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.355730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.355864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.356121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.356290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.356680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.356680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.356680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.356968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.356968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.356968] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 1034.386493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.386681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.386718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.387019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.387222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.397065] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 1034.449266] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.951842] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1034.952028] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1035.844582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.844916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.844916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.845082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.857777] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1035.858741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.860212] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1035.896711] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.896938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.897030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.897195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.908266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.908901] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1035.908985] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1035.909093] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1035.949219] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.949440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.949440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.949623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.951125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.951328] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1036.037794] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.037794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.037794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.037794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.038750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.038750] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1036.114376] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.114589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.114737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.114950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.115255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.115845] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1036.115952] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1934d43b-3b83-45a9-9b48-612e7248acc7', '27a5e149-5084-473e-990e-2dfe2bf8717f', '2994e442-555a-4a06-b1c7-b7bebbd61b5f', 'cac32beb-4c24-4e53-9268-c02bfdb859d7', '31ff7630-123f-4898-982a-bb6d45f72689', '11551b08-d7e5-440b-b40c-112c2d7e5430', 'b9c0dc90-8346-4983-bb7f-1dc141d9364f', 'e5a2a36a-9776-4e8f-af73-6d8b077adfff', '72a5ebce-3df0-4dab-b5cb-7ec6881e7385', 'ca2d1c57-a6bd-4f0c-9911-e018a46e3355', 'fb1b3f1f-58a0-4338-b901-3409378a1ece', '15784b52-ff73-4fa3-a18b-f8082c6f3c89', '40309f57-4f06-40c4-9838-656b00d3acea', 'abf1fd06-b056-4d16-b440-25af92d62920', 'f1faaf9f-2e81-4209-bb0c-5887f3619279', '18c4bf50-a472-475c-9016-e8ba33d62ca9', '154abdb7-4268-41a3-bf4b-26f5e9656c76', '40f16dbf-b372-4ba6-94a5-e3bf17f87f96', '5e282651-46df-44c0-8922-eca67aa74d66', '78855541-03b8-4d32-871e-c374cb44f414', '1befdc0c-fdef-47d8-a265-90eb419b7428', '568eca14-d302-4960-af0c-9198176e727f', '09eeb8ed-53fe-4534-ba39-d93429300967', 'a096698e-b6ff-45f7-a422-2ae93392dd6a', '511a8f2f-3767-4d34-9d44-c9a6cd510c1a', '1a40b8a7-01bb-4eb9-8b40-fe7596c9d197', '0ce292fb-ef03-4deb-8b4d-98b3ea31c815', 'ed152bbd-2522-4d15-9d17-a181bc283606', '7a32e7cc-5871-4cac-93b4-13eb1e04d001', 'eb75ad9c-4e20-475c-9f48-9dc0b70cd915', 'cec5d72a-5222-4ea2-bb61-5a248eace68e', 'cb24203d-c552-4146-a5ac-8b7d840c9508', '78d97212-9ce9-44c7-aea3-cb927043ab34', '77b26c46-fbab-436a-bd4d-c5014107aa41', '07660c72-b919-4d62-b37d-9ae294d80c7d', 'd044d815-6af5-4fd9-a0b1-bc64182a7697', 'a4688087-743d-4d09-ac40-3272e1f90bc5', '75aafba1-23a9-48ba-a855-7337f0a9b868', '21f74596-fb6a-47cf-899d-a4910bf5e050', 'b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a', 'a7c347da-631c-445c-b2e6-004a6894e069', 'a698aa11-3871-4c02-b0a5-985be0e71f6d'} {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1036.116091] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1036.136682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.136946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.137104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.137250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.137833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.137833] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1036.137833] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1036.137833] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1036.246493] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.246644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.246705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.248190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.248190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248190] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1036.248529] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1036.248529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1036.248529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1036.248529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1036.248529] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGH for action security_group_rules [ 1036.248801] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGH for action security_group_rules [ 1036.248801] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGH for action security_group_rules [ 1036.248801] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGH for action security_group_rules [ 1036.248801] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGH for action security_group_rules [ 1036.248944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGH for action security_group_rules [ 1036.248944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGH for action security_group_rules [ 1036.248944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGH for action security_group_rules [ 1036.249058] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGH for action security_group_rules [ 1036.249249] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1036.249357] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGH for action security_group_rules [ 1036.249420] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGH for action security_group_rules [ 1036.249480] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGH for action security_group_rules [ 1036.249540] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGH for action security_group_rules [ 1036.249599] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGH for action security_group_rules [ 1036.249660] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGH for action security_group_rules [ 1036.249719] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 1036.249780] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGH for action security_group_rules [ 1036.249840] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGH for action security_group_rules [ 1036.249901] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGH for action security_group_rules [ 1036.249994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.408614] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 1036.408614] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 1036.408614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.851458] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1038.851798] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1038.851798] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 with Priority: HIGH for action security_group_rules [ 1038.851923] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGH for action security_group_rules [ 1038.852093] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGH for action security_group_rules [ 1038.852217] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 with Priority: HIGH for action security_group_rules [ 1038.852322] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGH for action security_group_rules [ 1038.852417] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGH for action security_group_rules [ 1038.852524] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 with Priority: HIGH for action security_group_rules [ 1038.852621] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 1038.852715] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGH for action security_group_rules [ 1038.852805] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 with Priority: HIGH for action security_group_rules [ 1038.852894] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40309f57-4f06-40c4-9838-656b00d3acea with Priority: HIGH for action security_group_rules [ 1038.852981] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGH for action security_group_rules [ 1038.853085] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1b3f1f-58a0-4338-b901-3409378a1ece with Priority: HIGH for action security_group_rules [ 1038.853190] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1038.853346] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 with Priority: HIGH for action security_group_rules [ 1038.853441] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 with Priority: HIGH for action security_group_rules [ 1038.853542] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGH for action security_group_rules [ 1038.853634] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ff7630-123f-4898-982a-bb6d45f72689 with Priority: HIGH for action security_group_rules [ 1038.853724] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a5e149-5084-473e-990e-2dfe2bf8717f with Priority: HIGH for action security_group_rules [ 1038.853819] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGH for action security_group_rules [ 1038.854236] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1934d43b-3b83-45a9-9b48-612e7248acc7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.854382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.854449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.854669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.854755] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1934d43b-3b83-45a9-9b48-612e7248acc7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.856633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.856746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.856820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.857073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.857194] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.858232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.859236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.859236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.859534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.859534] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.860481] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1faaf9f-2e81-4209-bb0c-5887f3619279 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.860481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.860481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.860693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.860737] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1faaf9f-2e81-4209-bb0c-5887f3619279',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.861648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.861765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.861820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.861984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.862066] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.863088] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.863204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.863272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.863426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.863500] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.864261] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.864375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.864441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.864674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.864742] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f16dbf-b372-4ba6-94a5-e3bf17f87f96',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.866866] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.867022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.867090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.867316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.867419] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.868275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.868674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.868745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.869728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.869825] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.870738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c4bf50-a472-475c-9016-e8ba33d62ca9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.870926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.870986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.871152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.871225] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c4bf50-a472-475c-9016-e8ba33d62ca9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.872660] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40309f57-4f06-40c4-9838-656b00d3acea taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.872660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.872660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.872660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.872660] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40309f57-4f06-40c4-9838-656b00d3acea',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.873499] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.873622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.873848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.873940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.874055] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.875082] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1b3f1f-58a0-4338-b901-3409378a1ece taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.875273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.875273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.875465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.875510] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1b3f1f-58a0-4338-b901-3409378a1ece',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.876264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.876628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.876628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.876929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.876929] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.877893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.878022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.878112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.878254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.878336] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72a5ebce-3df0-4dab-b5cb-7ec6881e7385',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.879023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11551b08-d7e5-440b-b40c-112c2d7e5430 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.879201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.879324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.879483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.879558] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11551b08-d7e5-440b-b40c-112c2d7e5430',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.880429] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.880546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.880608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.880843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.880918] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.881718] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ff7630-123f-4898-982a-bb6d45f72689 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.881966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.882068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.882321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.882321] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ff7630-123f-4898-982a-bb6d45f72689',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.883028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a5e149-5084-473e-990e-2dfe2bf8717f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.883138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.883206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.883366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.883439] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a5e149-5084-473e-990e-2dfe2bf8717f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.884267] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.884378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.884431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.884581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.884644] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.910385] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.910564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.910619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.910850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934792] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934792] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1934d43b-3b83-45a9-9b48-612e7248acc7 is going to be deleted. [ 1038.955046] env[65119]: INFO networking_nsxv3.common.synchronization [req-81c9f8d9-3dba-451c-83e5-b6d9bc2e638a req-6e4a565c-841c-45f9-b88c-c00b4bbc8e4c tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1038.955265] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1038.956264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.956264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.956264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.956264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.956514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.956585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.957162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.957162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.958035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.958035] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.987819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.987914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.987963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.988473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.988473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.988473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1934d43b-3b83-45a9-9b48-612e7248acc7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.386639] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.386639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.386866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.387095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.387178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.387317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.387411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.387615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.387731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.387847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.388024] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.389478] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.389478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.393603] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.393723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.393783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.393970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.394130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.394228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.394292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.394436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.394518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.394652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.394741] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.396614] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.396729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.396783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.396956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.397083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.397172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.397229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.397362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.397441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.397565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.397605] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.401014] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.401135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.401209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.401360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.401508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.401604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.401673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.401803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.401874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.401957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.402046] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.404125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.404230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.404292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.404468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.404629] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.404732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.404812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.404968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.405098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.405166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.405221] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.412870] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.412870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.412870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.412870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.412870] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.413239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.413239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.413239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.413239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.413373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.413483] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.413586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.413691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.414011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.414011] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.414011] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.414265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.414265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.414335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.414394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.414485] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.416104] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.416215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.416294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.416512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.416588] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.416698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.417390] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.417390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.417741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.417741] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.417741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.417874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.417916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.418009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.418106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.418191] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.422718] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.422718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.422892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.422935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.423272] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.423272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.423272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.423455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.423455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.423543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.423621] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.429421] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15784b52-ff73-4fa3-a18b-f8082c6f3c89: rpc.has_security_group_logging(os_id): False [ 1039.432689] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.433564] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9c0dc90-8346-4983-bb7f-1dc141d9364f: rpc.has_security_group_logging(os_id): False [ 1039.463514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.463809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.463809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.463957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.478520] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.478920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.479679] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.479816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.480703] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.480841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.481538] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.481636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.482310] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.482672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483550] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.483550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483907] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.483995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.484787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.484887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.485808] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.485808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.486462] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.486590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.487173] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.487659] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.487766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.488505] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.488948] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.489093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.489869] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.490336] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.490437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.491151] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.491548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.491698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.495158] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.495500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.496156] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.496156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.496156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.496346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.496346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.496494] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1039.497566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.497735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.517893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.518152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72a5ebce-3df0-4dab-b5cb-7ec6881e7385 is going to be deleted. [ 1039.519253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.519511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.532173] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.532339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.532453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.532704] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.537087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.541492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.543494] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11551b08-d7e5-440b-b40c-112c2d7e5430 is going to be deleted. [ 1039.544686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.544942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.547655] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1039.567295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.567481] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1faaf9f-2e81-4209-bb0c-5887f3619279 is going to be deleted. [ 1039.568598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.568843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.593101] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.593101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.597587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.598572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.598572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.598572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.598572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.598572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.598850] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.598898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.598930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.599094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.599168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.599356] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.599453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.599508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.599629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.599697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.599788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 1039.601017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.603045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.603045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.603045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.644664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.644664] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be deleted. [ 1039.644664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.645151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.677578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.677578] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c4bf50-a472-475c-9016-e8ba33d62ca9 is going to be deleted. [ 1039.677578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.677578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.728456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.728671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.746613] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.746769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.757154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.757298] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40309f57-4f06-40c4-9838-656b00d3acea is going to be deleted. [ 1039.758406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.758894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.793149] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.793440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.809435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.809816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.809953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.810040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.810295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.810394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.810599] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.810706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.810770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.810958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.811080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.811322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.811401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.811462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.811611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.811687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.811783] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1039.813397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.813574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.823075] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.823253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.860859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.861174] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f16dbf-b372-4ba6-94a5-e3bf17f87f96 is going to be deleted. [ 1039.861955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.862190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.903837] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.904120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.906508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.906637] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ff7630-123f-4898-982a-bb6d45f72689 is going to be deleted. [ 1039.907575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.907788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.908762] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.910636] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.928805] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.937300] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5a2a36a-9776-4e8f-af73-6d8b077adfff: rpc.has_security_group_logging(os_id): False [ 1039.939327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.939542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.967681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.967869] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be deleted. [ 1039.968963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.969260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.989268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.989486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.011786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.011929] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be deleted. [ 1040.013022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.013271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.013389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.013483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72a5ebce-3df0-4dab-b5cb-7ec6881e7385" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.013673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.013833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.034579] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.034737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.069523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.069702] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1b3f1f-58a0-4338-b901-3409378a1ece is going to be deleted. [ 1040.070862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.071106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.071230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.071451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11551b08-d7e5-440b-b40c-112c2d7e5430" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.071679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.071937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.072089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.072296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1faaf9f-2e81-4209-bb0c-5887f3619279" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.072879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.073130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.073351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.074481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.074682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.074797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.074957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.075154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.075374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.102045] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.102045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.112898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 1040.123085] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.123241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.131354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.131476] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a5e149-5084-473e-990e-2dfe2bf8717f is going to be deleted. [ 1040.132508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.132763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.132859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.132980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c4bf50-a472-475c-9016-e8ba33d62ca9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.133156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.133317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.133398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.133509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40309f57-4f06-40c4-9838-656b00d3acea" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.135151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.135151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.135151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.135981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.136172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.161947] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.161947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.162379] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1040.194678] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.194867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.216429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.216802] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.216920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.216965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.217206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.217291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.217389] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff is going to be updated. [ 1040.218531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.218729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.218805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.218922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f16dbf-b372-4ba6-94a5-e3bf17f87f96" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.219075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.219236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.219310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.219423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ff7630-123f-4898-982a-bb6d45f72689" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.219568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.219714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.219791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.219908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.220036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.220183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.220274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.220388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.220958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.221135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.221254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.221383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1b3f1f-58a0-4338-b901-3409378a1ece" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.244020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.244020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.244020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.244020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.244020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.244020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a5e149-5084-473e-990e-2dfe2bf8717f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.325233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.325429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.325508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.325731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.325893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.381683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: IN_PROGRESS for 2s [ 1040.412936] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2d1c57-a6bd-4f0c-9911-e018a46e3355: rpc.has_security_group_logging(os_id): False [ 1040.412936] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf1fd06-b056-4d16-b440-25af92d62920: rpc.has_security_group_logging(os_id): False [ 1040.430570] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cac32beb-4c24-4e53-9268-c02bfdb859d7: rpc.has_security_group_logging(os_id): False [ 1040.433024] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.433213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.433260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.433441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.434903] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.435023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.447918] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.448051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.454321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.454729] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.454832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.454896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.455107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.455275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.455275] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 1040.456371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.456548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.490629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.491032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.491171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.491239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.491453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.491540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.491629] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1040.492729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.492909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.524831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.525155] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.525283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.525354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.525596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.525664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.525730] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 is going to be updated. [ 1040.542913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.543124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.543124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.543604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.543604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.556289] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 1040.583056] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.583056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.583056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.583056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.583056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.595648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.595856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.595856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.596119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.596269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.599811] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1040.606382] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: IN_PROGRESS for 2s [ 1041.559971] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1041.560267] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 1041.560367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.560550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.560842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.561128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.561209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.561277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.561486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.561621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.561738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.561864] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.064882] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.065111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.065197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.065409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.065705] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.065892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.065967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.066186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.066241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.066325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.066487] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.066581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.066699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.066838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.067134] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.067134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.067134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.067484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.067484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.067484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.067484] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.132584] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 1042.132872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.175150] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1042.175515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.281058] env[65119]: INFO networking_nsxv3.common.synchronization [req-53cbbe76-114c-4da1-a6d8-e3909781f9bf req-89da41d1-f0da-4a77-a708-760aaefd8aa1 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1042.281262] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1042.281672] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.281833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.281833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.282458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.282458] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.282458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.282458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.282701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.282701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.282767] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.405365] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: SUCCESS [ 1042.405365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.570570] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 1042.572603] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 1042.572925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.587437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.587648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.587696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.587892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.588443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.588443] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.588591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.588626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.588782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.588862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.589075] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.589178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.589253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.589388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.589462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.589648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.589738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.589800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.589938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.590017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.590105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1042.612250] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1042.612471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.617588] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: SUCCESS [ 1042.617883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.672208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.672370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.672420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.672683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.672855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.689791] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1042.785351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.785351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.785620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.785657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.785769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.785969] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.786101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.786163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.786386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.786511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.786604] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1042.827707] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.827853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.827926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.828413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.828413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.838970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1043.418154] env[65119]: INFO networking_nsxv3.common.synchronization [req-48b32229-c888-456f-8cb5-0e3a548da914 req-e96ff95f-f9fa-4c69-a193-749dcee73a68 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 1043.418867] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGHEST for action security_group_members [ 1043.419227] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.419438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.419438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.419669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.419831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.419932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.419994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.420157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.420259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.420431] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.923627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.923950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.923950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.924250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.948786] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.949015] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.949127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.949190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.949393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.949472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.949563] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568eca14-d302-4960-af0c-9198176e727f is going to be updated. [ 1043.979048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.979351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.979441] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.979698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.979921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.992686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: IN_PROGRESS for 2s [ 1044.707375] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1044.707654] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.851952] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1044.852160] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 deletion is rescheduled due to dependency. [ 1044.854554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.003407] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568eca14-d302-4960-af0c-9198176e727f in Status: SUCCESS [ 1046.003407] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568eca14-d302-4960-af0c-9198176e727f deletion is rescheduled due to dependency. [ 1046.003407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.091444] env[65119]: INFO networking_nsxv3.common.synchronization [req-d24c78c3-ab01-46d5-88e6-c27a2963e6c6 req-cede534d-d884-4472-92e3-296e66b2162d tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1046.092414] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1046.092414] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.092414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.092414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.092414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.092682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.092868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.092868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.093069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.093192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.093319] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.431745] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.431899] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.431961] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.432205] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.432472] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.432693] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.432766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.432940] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.433087] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.433291] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.433410] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.433509] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.433615] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.433722] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.433825] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.433952] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.455915] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.456216] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1046.456494] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.457391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-780" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.457765] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-a516072b-378e-4d48-8121-997c73437b08 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.457966] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.458123] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.458617] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.458682] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a516072b-378e-4d48-8121-997c73437b08',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.595968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.596437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.596437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.596597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.596705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.596916] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.597049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.597124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.597337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.597419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.597506] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be deleted. [ 1046.633498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.633675] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.633770] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.634009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.634077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.634234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.961222] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.961472] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.961590] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.961875] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.962039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.962200] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port a516072b-378e-4d48-8121-997c73437b08 not found, creating... [ 1046.962461] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.962622] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.962741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.962964] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.963111] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.963389] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.963650] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.963764] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.964013] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.965546] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.967745] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: a516072b-378e-4d48-8121-997c73437b08 is going to be created. [ 1046.989585] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.989792] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.989911] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.990230] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.990499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.990721] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.750408] env[65119]: INFO networking_nsxv3.common.synchronization [req-d24c78c3-ab01-46d5-88e6-c27a2963e6c6 req-1473f835-2007-4f3d-a295-65fb6f419f84 service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 1047.754130] env[65119]: INFO networking_nsxv3.common.synchronization [req-d24c78c3-ab01-46d5-88e6-c27a2963e6c6 req-1473f835-2007-4f3d-a295-65fb6f419f84 service nova] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1047.754130] env[65119]: INFO networking_nsxv3.common.synchronization [req-d24c78c3-ab01-46d5-88e6-c27a2963e6c6 req-1473f835-2007-4f3d-a295-65fb6f419f84 service nova] Enqueued Resource ID: a516072b-378e-4d48-8121-997c73437b08 with Priority: HIGHEST for action port [ 1047.754130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_rules [ 1047.754130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1047.754130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a516072b-378e-4d48-8121-997c73437b08 with Priority: HIGHEST for action port [ 1047.754130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.754130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.754130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.754130] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.754130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.754130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.755165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.755521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.758987] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.758987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a516072b-378e-4d48-8121-997c73437b08 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.758987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.758987] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a516072b-378e-4d48-8121-997c73437b08',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.259792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.259976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.260252] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.262211] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a516072b-378e-4d48-8121-997c73437b08 with status ACTIVE [ 1048.262485] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.262661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.262752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.264010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.264295] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.264558] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.265070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.265186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.265418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.265530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.265781] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.265912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.265999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.266228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.266335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.266460] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a516072b-378e-4d48-8121-997c73437b08 is going to be updated. [ 1048.288054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.288288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.288288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.288418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.288552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.288707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a516072b-378e-4d48-8121-997c73437b08" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.579326] env[65119]: INFO networking_nsxv3.common.synchronization [req-4996fcee-62a9-4307-be54-7577a4f18362 req-8c0d7429-d302-462c-ab5b-8aa28b2f0a7f tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1048.579958] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1048.580542] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.580675] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.580808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.581095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.581283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.581367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.581414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.581565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.581647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.581762] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.769326] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.938038] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.938265] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.938480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.938785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.939102] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.939263] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.939401] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.939642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.939785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.939999] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.940342] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.940433] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.940578] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.940711] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.940837] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.940994] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.963956] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.964184] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.964325] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.964504] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.964828] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-dd129098-28fe-4afa-b985-3929ba460c14 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.964999] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.965133] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.965628] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.965782] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd129098-28fe-4afa-b985-3929ba460c14',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.083718] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.273057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.273057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.273057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.273057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.273057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.273057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 1049.295651] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.295856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.295904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.296127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.296292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.306183] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: UNINITIALIZED for 2s [ 1049.377563] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9d785506-1f07-4970-944c-39f3508905cc None None] Enqueued Resource ID: b9d84271-f681-4623-b1c0-86e721fe9751 with Priority: HIGHEST for action port [ 1049.378585] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d84271-f681-4623-b1c0-86e721fe9751 with Priority: HIGHEST for action port [ 1049.378922] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d84271-f681-4623-b1c0-86e721fe9751 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.379066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d84271-f681-4623-b1c0-86e721fe9751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.379145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d84271-f681-4623-b1c0-86e721fe9751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.379482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d84271-f681-4623-b1c0-86e721fe9751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.379602] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d84271-f681-4623-b1c0-86e721fe9751',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.468478] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.468722] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.468865] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.469172] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.469332] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.469490] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port dd129098-28fe-4afa-b985-3929ba460c14 not found, creating... [ 1049.469754] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.469918] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.470058] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.470288] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.470455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.471067] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.471290] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.471431] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.471660] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.471796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.471938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: dd129098-28fe-4afa-b985-3929ba460c14 is going to be created. [ 1049.493882] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.494127] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.494254] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.494546] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.494780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.495013] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.586280] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.616296] env[65119]: INFO networking_nsxv3.common.synchronization [req-1585cfa5-377d-4261-98d2-373a1318cd5f req-6a6b2a54-1e71-43e7-ae81-ff5f3544b272 tempest-ServerRescueTestJSON-755354593 tempest-ServerRescueTestJSON-755354593-project-member] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1049.616868] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1049.617909] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.618130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.618181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.618219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.618375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.618461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.618555] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.882333] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9d84271-f681-4623-b1c0-86e721fe9751 [ 1049.882726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.882818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.882818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.883495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.883495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.883655] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9d84271-f681-4623-b1c0-86e721fe9751 already deleted. [ 1049.883813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d84271-f681-4623-b1c0-86e721fe9751" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.088559] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.089664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.089780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.089967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.090077] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.090180] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1050.126023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.126023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.126023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.126023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.126023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.126023] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.136576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1050.216959] env[65119]: INFO networking_nsxv3.common.synchronization [req-4996fcee-62a9-4307-be54-7577a4f18362 req-3ce035a9-6ca8-46d2-b35d-1f7bf20049a0 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1050.217171] env[65119]: INFO networking_nsxv3.common.synchronization [req-4996fcee-62a9-4307-be54-7577a4f18362 req-3ce035a9-6ca8-46d2-b35d-1f7bf20049a0 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1050.217383] env[65119]: INFO networking_nsxv3.common.synchronization [req-4996fcee-62a9-4307-be54-7577a4f18362 req-3ce035a9-6ca8-46d2-b35d-1f7bf20049a0 service nova] Enqueued Resource ID: dd129098-28fe-4afa-b985-3929ba460c14 with Priority: HIGHEST for action port [ 1050.218021] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1050.218021] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1050.218173] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd129098-28fe-4afa-b985-3929ba460c14 with Priority: HIGHEST for action port [ 1050.218494] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.218681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.218681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.218900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.218943] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.219990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.219990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.220140] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd129098-28fe-4afa-b985-3929ba460c14 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.220285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.220333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.220509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.220582] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd129098-28fe-4afa-b985-3929ba460c14',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.334018] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ad30bc58-18ad-48f2-8a91-66aa7438764d tempest-ServerActionsV293TestJSON-1222267651 tempest-ServerActionsV293TestJSON-1222267651-project-member] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1050.334018] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1050.334018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.334018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.334018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.334018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.334018] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.442895] env[65119]: INFO networking_nsxv3.common.synchronization [None req-f237486b-89d8-4e95-85be-f3feed1ffff0 tempest-ServerActionsV293TestJSON-1222267651 tempest-ServerActionsV293TestJSON-1222267651-project-member] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1050.443473] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1050.443788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.443886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.630017] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.722327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.722491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.722719] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd129098-28fe-4afa-b985-3929ba460c14 with status ACTIVE [ 1050.723148] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.723148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.723148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.723384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.723483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.723687] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.723821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.723888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.724663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.724663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.724663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.724663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.724663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.724970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.724970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.724970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd129098-28fe-4afa-b985-3929ba460c14 is going to be updated. [ 1050.755373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.755569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.755617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.755851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.756032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.756228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd129098-28fe-4afa-b985-3929ba460c14" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.868316] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.868316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.868316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.868316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.868316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.868666] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 already deleted. [ 1050.868666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.868742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.868886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.868941] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.134675] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.135049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.135049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.135178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.135250] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.135689] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be updated. [ 1051.165299] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.165571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.165674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.165932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.166130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.175879] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 1051.318726] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.318726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.318726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.318726] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.399429] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.399429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.399429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.399429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.399429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.399429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 already deleted. [ 1051.399429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.821138] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.821138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.821431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.821431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.821619] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.821718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.821785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.821945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.822042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.822142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.822858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.822858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.822858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.822858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.822858] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.822858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.822858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.823344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.823344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.823344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.823344] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.147287] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1052.147657] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.147722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.147911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.148317] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.148502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.148569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.148781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.148855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.148917] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.327628] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154abdb7-4268-41a3-bf4b-26f5e9656c76: rpc.has_security_group_logging(os_id): False [ 1052.353080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.353080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.353080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.354361] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.355150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.355571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.356248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.356248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.356248] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be created. [ 1052.402674] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1a19921a-644a-4acc-aeb7-158f97c7fc92 None None] Enqueued Resource ID: 7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7 with Priority: HIGHEST for action port [ 1052.403709] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7 with Priority: HIGHEST for action port [ 1052.404239] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.404473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.404601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.404876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.404985] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.451991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.452324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.452413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.452648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.452840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.477524] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 1052.653653] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.909024] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7 [ 1052.909318] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.909474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.909547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.909749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.909836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.909957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7 already deleted. [ 1052.910019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fdd7cbf-2524-4c8a-83c6-7c34b851bcd7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.158309] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.186030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 1053.186030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.659795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.659961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.660047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.660262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.660355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.660576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1053.694970] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.695156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.695307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.695473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.695624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.707177] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1054.503515] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 1054.504204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.717542] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1055.717542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.718666] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.718666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.719150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.719150] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.220888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.221147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.221262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.221547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.221746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.221840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.221918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.222118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.222280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.222332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.222453] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.222576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.222686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.222787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.222978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.223049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.223089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.224236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.224236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.224236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.224236] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.702151] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1f9e35d6-5966-47aa-a57c-a17e2bd1b942 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1056.702692] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1056.703039] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.703165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.703233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.703493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.703593] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.727670] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1056.751106] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.752673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.752673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.752673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.774036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.774453] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.774664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.774851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.775161] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.775304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.775599] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.775823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.775883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.776198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.776243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.776547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.776631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.776732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.776940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.777067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.777280] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1056.800566] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8357387a-f37c-4a47-89a6-d2945a1359c4 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1056.801163] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1056.801509] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.801614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.840745] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.841196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.841196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.841196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.841404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.873069] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1057.226662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.226662] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ab408e-051b-41f8-8797-d5537be1217f already deleted. [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.226662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.226662] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.748820] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.748820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.748820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.748820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.749289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.749289] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ab408e-051b-41f8-8797-d5537be1217f already deleted. [ 1057.749289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.794242] env[65119]: INFO networking_nsxv3.common.synchronization [req-ed689501-1a5f-47c9-aae3-6080f4f6df2e req-403aad14-cb76-4e6b-881b-971f129e6774 tempest-ServersWithSpecificFlavorTestJSON-1351200552 tempest-ServersWithSpecificFlavorTestJSON-1351200552-project-member] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 1058.794882] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGHEST for action security_group_members [ 1058.795399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.795506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.795577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.795794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.795956] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.797955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.798083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.798272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.798447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.798447] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.812311] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8fe5ed77-c838-49c8-a9de-3bf85a3183df tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1058.813539] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1058.814133] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.814254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.814254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.814914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.815036] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.890670] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1058.890904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.949266] env[65119]: INFO networking_nsxv3.common.synchronization [None req-a5771e47-e06a-40fb-a114-24eaac2488a4 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1058.950998] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1058.951392] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.951514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.302023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.302023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.302023] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.302529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.302529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be updated. [ 1059.336633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.336837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.339863] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d already deleted. [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.339863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.339863] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.341485] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.341638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.341724] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.342243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.342243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.353341] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: IN_PROGRESS for 2s [ 1059.859095] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.859095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.859648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.859648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.859648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.859648] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d already deleted. [ 1059.859648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.466875] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-283 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.467130] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.467267] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.467580] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.468215] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.468215] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.468415] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.468547] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.468711] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.468925] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.469048] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.469372] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.470438] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.470438] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.470438] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.470438] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.490869] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.491183] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.491499] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.491709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.492065] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.492277] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.492430] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.492658] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.492814] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.996530] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.996941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.996941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.997249] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.997441] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.997834] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.998017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.998141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.998363] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.998501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.998834] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.999046] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.999193] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.999406] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.999538] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.999679] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb is going to be updated. [ 1061.023327] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.023662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.023808] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.024125] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.025555] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.025790] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.363968] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf1fd06-b056-4d16-b440-25af92d62920 in Status: SUCCESS [ 1061.364985] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf1fd06-b056-4d16-b440-25af92d62920 deletion is rescheduled due to dependency. [ 1061.364985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.734913] env[65119]: INFO networking_nsxv3.common.synchronization [req-cb86da67-4496-4ea6-af07-516470d1bb7d req-40765877-c428-450c-a2cc-110788c58335 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1061.735606] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1061.738018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.738381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.738505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.738950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.739085] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.739189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.739255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.739548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.739548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.739768] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.750864] env[65119]: INFO networking_nsxv3.common.synchronization [req-39a5383c-85d4-4d77-ac44-5ad16425a004 req-3939131d-bd29-4472-ba51-043a13ef2bab service nova] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 1061.751081] env[65119]: INFO networking_nsxv3.common.synchronization [req-39a5383c-85d4-4d77-ac44-5ad16425a004 req-3939131d-bd29-4472-ba51-043a13ef2bab service nova] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 1061.751248] env[65119]: INFO networking_nsxv3.common.synchronization [req-39a5383c-85d4-4d77-ac44-5ad16425a004 req-3939131d-bd29-4472-ba51-043a13ef2bab service nova] Enqueued Resource ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with Priority: HIGHEST for action port [ 1061.755087] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_rules [ 1061.755087] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 1061.755087] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with Priority: HIGHEST for action port [ 1061.755087] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.755087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.755087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.755087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.755087] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.755087] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.755087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.755087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.755636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.755636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.755636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.755636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.755809] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.755844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.756443] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.756984] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.757431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.757431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.757431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.757431] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.014337] env[65119]: INFO networking_nsxv3.common.synchronization [req-f13b95e6-9c1f-4706-8062-a67d71faeb31 req-a801841a-b28a-48e6-8caf-99d35003da59 tempest-ServerDiskConfigTestJSON-939816777 tempest-ServerDiskConfigTestJSON-939816777-project-member] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1062.016560] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGHEST for action security_group_members [ 1062.016560] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.016560] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.016560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.016560] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.241743] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.259175] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.259442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.259523] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.261148] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb with status ACTIVE [ 1062.261367] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.261480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.261567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.261850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.261940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.262260] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.262379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.262540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.262603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.262722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.262968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.263118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.263177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.263325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.263401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.263491] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb is going to be updated. [ 1062.285549] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.285900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.285985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.286186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.286322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.286486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1dfd3a-f884-4b9f-aa4f-54f73fe20feb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.518578] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.518833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.518887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.519113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.519205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.519410] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.519522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.519589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.519806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.519887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.519979] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be updated. [ 1062.555878] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.556063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.556114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.556918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.557096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.566997] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: IN_PROGRESS for 2s [ 1062.744766] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.761482] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.247828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.248213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.248213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.248296] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.248379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.248475] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1063.263611] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.263790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.263917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.264184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.264257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.264495] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be updated. [ 1063.283275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.283425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.283497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.283707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.283855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.293971] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1063.295986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.296134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.296197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.296395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.296536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.303977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: IN_PROGRESS for 2s [ 1064.581142] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 in Status: SUCCESS [ 1064.581484] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 deletion is rescheduled due to dependency. [ 1064.581484] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.304657] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1065.304899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.312652] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: SUCCESS [ 1065.312857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.313064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.313279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.314928] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.314928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.314928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.314928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.314928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.314928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.314928] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.817040] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.319837] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e282651-46df-44c0-8922-eca67aa74d66: rpc.has_security_group_logging(os_id): False [ 1066.338673] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.338859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.338934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.339192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.339286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.339556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.339659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.339725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.339878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.339954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.340054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be created. [ 1066.399637] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.399637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.399933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.399933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.400427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.418131] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: IN_PROGRESS for 2s [ 1067.015774] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1067.016206] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1068.194074] env[65119]: INFO networking_nsxv3.common.synchronization [req-bf0b6374-2cd3-4114-9b9f-4177bdd2174e req-680a23cf-3e24-48e1-9d0f-f9bac4bbef74 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1068.194370] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1068.194543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.194599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.194644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.194856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.195028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.195132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.195189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.195337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.195419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.195514] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.298536] env[65119]: INFO networking_nsxv3.common.synchronization [req-ddd2588c-5016-4016-8b69-e57ead4b4bc4 req-2d788815-e759-48ca-9ed4-566704fa5bfb tempest-ServerRescueTestJSON-755354593 tempest-ServerRescueTestJSON-755354593-project-member] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1068.299283] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGHEST for action security_group_members [ 1068.299622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.299745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.299836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.300055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.300249] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.300359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.300429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.300604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.300721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.300830] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.434958] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: SUCCESS [ 1068.435181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.569495] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.569829] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.570034] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.570429] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.570791] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.571017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.571180] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.571584] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.571878] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.572263] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.572452] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.572654] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.572843] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.573064] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.573258] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.573499] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.596730] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.596898] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.597028] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.597221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-252" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.597633] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-604860b6-bbaa-4236-b133-9c9ce410ed77 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.597816] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.597939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.598377] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.598562] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('604860b6-bbaa-4236-b133-9c9ce410ed77',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.698216] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.698434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.698483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.698685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.698882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.698986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.699159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.699223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.699381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.699469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.699560] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1068.739151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.739368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.739368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.739575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.739720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.756612] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1068.802920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.803190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.803261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.803466] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.830588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.830814] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.830932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.830998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.831234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.831405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.831466] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be updated. [ 1068.866043] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.866269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.866269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.866543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.866701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.881326] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: IN_PROGRESS for 2s [ 1069.102743] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.102743] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 604860b6-bbaa-4236-b133-9c9ce410ed77 not found, creating... [ 1069.102743] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.102743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.103780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.103780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.103780] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.103780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.103780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.104228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.104228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.104228] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 604860b6-bbaa-4236-b133-9c9ce410ed77 is going to be created. [ 1069.128711] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.128988] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.129148] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.129884] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.130151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.130379] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.866683] env[65119]: INFO networking_nsxv3.common.synchronization [req-bf0b6374-2cd3-4114-9b9f-4177bdd2174e req-58816569-f367-480b-a338-5b144fa86430 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 1069.866980] env[65119]: INFO networking_nsxv3.common.synchronization [req-bf0b6374-2cd3-4114-9b9f-4177bdd2174e req-58816569-f367-480b-a338-5b144fa86430 service nova] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1069.867267] env[65119]: INFO networking_nsxv3.common.synchronization [req-bf0b6374-2cd3-4114-9b9f-4177bdd2174e req-58816569-f367-480b-a338-5b144fa86430 service nova] Enqueued Resource ID: 604860b6-bbaa-4236-b133-9c9ce410ed77 with Priority: HIGHEST for action port [ 1069.868626] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_rules [ 1069.869255] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1069.869255] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604860b6-bbaa-4236-b133-9c9ce410ed77 with Priority: HIGHEST for action port [ 1069.870153] env[65119]: INFO networking_nsxv3.common.synchronization [req-76dde646-f0fd-4baf-ad7a-cc368997335d req-47268b88-bc4c-4818-90cb-27ec4cf6db35 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1069.870568] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.870689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.870791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.870934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.871048] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.872452] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.872570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.872935] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-604860b6-bbaa-4236-b133-9c9ce410ed77 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.873115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.873254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.873436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.873546] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('604860b6-bbaa-4236-b133-9c9ce410ed77',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.874728] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1069.875583] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.875694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.875787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.876147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.876320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.876423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.876490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.876644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.876735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.876829] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.200257] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.200492] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.200659] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.200991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.201321] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.201501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.201711] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.201878] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.202105] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.202362] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.202494] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.202633] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.202773] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.202954] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.203128] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.203273] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.227335] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.227528] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.227633] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.227850] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.228166] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-41347a8d-a0d0-4106-9c4b-c56f0eecf276 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.228393] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.228501] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.228943] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.229113] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41347a8d-a0d0-4106-9c4b-c56f0eecf276',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.379025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 604860b6-bbaa-4236-b133-9c9ce410ed77 with status ACTIVE [ 1070.379025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.379025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.379025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.379025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.379025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.379025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.379444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.379444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.379444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.379444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.379568] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.379699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.379754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.379943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.380039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.380250] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 604860b6-bbaa-4236-b133-9c9ce410ed77 is going to be updated. [ 1070.381283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.381418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.382291] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.382396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.382467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.382608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.382687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.382857] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.382958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.383021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.383183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.383297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.383380] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be deleted. [ 1070.426151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.426334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.426503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.426614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.426768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.426984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-604860b6-bbaa-4236-b133-9c9ce410ed77" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.433096] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.433096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.433280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.433390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.433478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.433576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.731835] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.732064] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.732202] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.732480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.732632] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.732786] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 41347a8d-a0d0-4106-9c4b-c56f0eecf276 not found, creating... [ 1070.733100] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.733344] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.733481] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.733637] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.733783] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.734083] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.734243] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.734361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.734572] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.734709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.734915] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 41347a8d-a0d0-4106-9c4b-c56f0eecf276 is going to be created. [ 1070.736866] env[65119]: INFO networking_nsxv3.common.synchronization [req-2c6a17a9-7908-4c7a-8e4b-8662613227ae req-79a640e4-9bb3-4672-8690-71654fa365b4 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1070.737562] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1070.738344] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.738507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.738599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.738886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.739078] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.739193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.739318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.739491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.739574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.739671] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.760921] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.761278] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.761342] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.761613] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.761859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.762100] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.765858] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 4s [ 1070.891848] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 in Status: SUCCESS [ 1070.892178] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 deletion is rescheduled due to dependency. [ 1070.892276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.086133] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.086133] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.086133] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.087018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.087350] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.087526] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.087647] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.087926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.088063] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.088276] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.088387] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.088492] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.088597] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.088725] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.088848] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.088980] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.108902] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.109096] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.109253] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.109444] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.109794] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.110008] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.110148] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.110490] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.110653] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1fdfd2-f7e1-40f2-875f-7f2b881e609d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.242327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.242483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.242565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.242822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.242879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.243065] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.243159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.243219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.243396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.243474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.243558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ab408e-051b-41f8-8797-d5537be1217f already deleted. [ 1071.243668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.470935] env[65119]: INFO networking_nsxv3.common.synchronization [req-76dde646-f0fd-4baf-ad7a-cc368997335d req-081ab3a7-3c9b-4f2d-9efe-cf980f91e0d2 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1071.471151] env[65119]: INFO networking_nsxv3.common.synchronization [req-76dde646-f0fd-4baf-ad7a-cc368997335d req-081ab3a7-3c9b-4f2d-9efe-cf980f91e0d2 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1071.471313] env[65119]: INFO networking_nsxv3.common.synchronization [req-76dde646-f0fd-4baf-ad7a-cc368997335d req-081ab3a7-3c9b-4f2d-9efe-cf980f91e0d2 service nova] Enqueued Resource ID: 41347a8d-a0d0-4106-9c4b-c56f0eecf276 with Priority: HIGHEST for action port [ 1071.471822] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1071.471955] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1071.472071] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41347a8d-a0d0-4106-9c4b-c56f0eecf276 with Priority: HIGHEST for action port [ 1071.472359] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.472480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.472541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.472801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.472886] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.474086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.474216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.474283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.474452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.474613] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.474729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.474791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.474917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.475009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.475119] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.475851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-41347a8d-a0d0-4106-9c4b-c56f0eecf276 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.475955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.476092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.476175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.476248] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41347a8d-a0d0-4106-9c4b-c56f0eecf276',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.613541] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.613859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.614051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.614371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.614588] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.614788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port bb1fdfd2-f7e1-40f2-875f-7f2b881e609d not found, creating... [ 1071.615223] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.615425] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.615607] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.615889] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.616078] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.616441] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.616687] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.616858] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.617141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.617309] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.617487] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: bb1fdfd2-f7e1-40f2-875f-7f2b881e609d is going to be created. [ 1071.649596] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.649918] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.650069] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.650573] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.650880] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.651142] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.977944] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.978997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.979127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.979284] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41347a8d-a0d0-4106-9c4b-c56f0eecf276 with status ACTIVE [ 1071.979447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.979544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.979603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.979808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.979954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.980180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.980280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.980346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.980513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.980587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.980807] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.980895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.980956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.982041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.982041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.982041] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41347a8d-a0d0-4106-9c4b-c56f0eecf276 is going to be updated. [ 1072.009070] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.009276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.009383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.009736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.009924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.010180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41347a8d-a0d0-4106-9c4b-c56f0eecf276" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.407930] env[65119]: INFO networking_nsxv3.common.synchronization [req-2c6a17a9-7908-4c7a-8e4b-8662613227ae req-8717e210-6c18-4089-8eb3-84b998f722ba service nova] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1072.408101] env[65119]: INFO networking_nsxv3.common.synchronization [req-2c6a17a9-7908-4c7a-8e4b-8662613227ae req-8717e210-6c18-4089-8eb3-84b998f722ba service nova] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1072.408255] env[65119]: INFO networking_nsxv3.common.synchronization [req-2c6a17a9-7908-4c7a-8e4b-8662613227ae req-8717e210-6c18-4089-8eb3-84b998f722ba service nova] Enqueued Resource ID: bb1fdfd2-f7e1-40f2-875f-7f2b881e609d with Priority: HIGHEST for action port [ 1072.408967] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_rules [ 1072.409351] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1072.409351] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1fdfd2-f7e1-40f2-875f-7f2b881e609d with Priority: HIGHEST for action port [ 1072.409773] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.409903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.409967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.410196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.410283] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.411734] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.411925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.411993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.412214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.412375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.412480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.412535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.412691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.412767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.412865] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.414089] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.414218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.414218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.414565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.414565] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1fdfd2-f7e1-40f2-875f-7f2b881e609d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.483676] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.781299] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1072.781508] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 1072.781719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.781927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.782604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.782604] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.782722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.782815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.783080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.783169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.783300] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.916514] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.919445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.919445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.919445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb1fdfd2-f7e1-40f2-875f-7f2b881e609d with status ACTIVE [ 1072.919626] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.919746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.919791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.920216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.920216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.922570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.922570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.922570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.923150] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb1fdfd2-f7e1-40f2-875f-7f2b881e609d is going to be updated. [ 1072.961716] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.961716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.961716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.961716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.961716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.961716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb1fdfd2-f7e1-40f2-875f-7f2b881e609d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.987095] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.987462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.987462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.987579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.987671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.987772] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be created. [ 1073.025868] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.026337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.026337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.026337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.026542] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.043731] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: UNINITIALIZED for 2s [ 1073.286780] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.426379] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.789823] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.928647] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.928647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.928647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.928647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.929113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.929113] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ab408e-051b-41f8-8797-d5537be1217f is going to be created. [ 1073.962433] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.962601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.962681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.962902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.963125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.978067] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: UNINITIALIZED for 2s [ 1074.294081] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.294081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.294081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.294650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.294650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.294650] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1074.340999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.341198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.341262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.341546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.341731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.355152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1075.015462] env[65119]: INFO networking_nsxv3.common.synchronization [req-1b3e2c40-ced7-4d29-9376-a3404527b50b req-30077337-9382-40f5-81f4-6060b2d790e1 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1075.016938] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1075.017417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.017608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.018027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.018267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.018524] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.018726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.018907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.019176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.019320] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.019568] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.054065] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1075.054342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.054528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.054745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.054945] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.055073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.055140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.055291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.055371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055547] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.342534] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.342534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.342534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.343323] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.343323] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.343323] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.343531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.343752] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.343941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.344411] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.344411] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.344411] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.345062] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.345062] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.345062] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.345062] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.365014] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.365332] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.365566] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.365851] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.366338] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-61304593-da90-44f4-89ff-7e23b4c97d2d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.366610] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.366796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.367269] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.367465] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61304593-da90-44f4-89ff-7e23b4c97d2d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.524263] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.524440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.524440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.524951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.524951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.525117] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.525218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.525273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.525482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.525595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.525802] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d already deleted. [ 1075.525802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.558243] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.558464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.558566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.558947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.559219] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.559393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.559488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.559687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.559781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.559887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.560057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.560169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.560236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.560388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.560544] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.560647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.560852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.561124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.561217] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.561304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.561393] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.871018] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.871219] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.871364] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.871665] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.871884] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.872108] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 61304593-da90-44f4-89ff-7e23b4c97d2d not found, creating... [ 1075.872447] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.872703] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.872894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.873569] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.873569] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.873688] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.873818] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.873937] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.874211] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.874346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.874493] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 61304593-da90-44f4-89ff-7e23b4c97d2d is going to be created. [ 1075.903625] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.903882] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.904062] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.904399] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.904646] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.904876] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.992158] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: SUCCESS [ 1075.992419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.992585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.992834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.993118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.993261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.993364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.993541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.993621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.993710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.993805] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.063626] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2994e442-555a-4a06-b1c7-b7bebbd61b5f: rpc.has_security_group_logging(os_id): False [ 1076.087552] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.087766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.087766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.087931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.088045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.088320] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.088477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.088538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.088729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.088846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.089803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.089803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.089803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.089803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.089803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.089803] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.089803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.090224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.090224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.090224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.090224] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be created. [ 1076.171460] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.171460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.171669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.171760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.172035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.186664] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1076.368969] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1076.369326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.369607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.369915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.370268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.370409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.370513] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.370829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.370981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.371152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.371316] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.497225] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.651260] env[65119]: INFO networking_nsxv3.common.synchronization [req-1b3e2c40-ced7-4d29-9376-a3404527b50b req-c14aeddc-bc9b-43dc-86ad-816a22d49c8e service nova] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1076.651260] env[65119]: INFO networking_nsxv3.common.synchronization [req-1b3e2c40-ced7-4d29-9376-a3404527b50b req-c14aeddc-bc9b-43dc-86ad-816a22d49c8e service nova] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1076.651260] env[65119]: INFO networking_nsxv3.common.synchronization [req-1b3e2c40-ced7-4d29-9376-a3404527b50b req-c14aeddc-bc9b-43dc-86ad-816a22d49c8e service nova] Enqueued Resource ID: 61304593-da90-44f4-89ff-7e23b4c97d2d with Priority: HIGHEST for action port [ 1076.651735] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_rules [ 1076.651735] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1076.651876] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61304593-da90-44f4-89ff-7e23b4c97d2d with Priority: HIGHEST for action port [ 1076.652986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.653291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.653291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.653502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.654477] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.655195] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.655326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.655399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.655586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.655892] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.655892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.656040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.656083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.656386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.656386] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.657042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-61304593-da90-44f4-89ff-7e23b4c97d2d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.657152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.657575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.657575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.657575] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61304593-da90-44f4-89ff-7e23b4c97d2d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.876206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.876428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.876477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.876681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.876853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.876954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.877040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.877199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.877288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.877378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.877522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.877633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.877714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.877887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.878041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.878138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.878216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.878464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.878464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.878464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.878672] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.000179] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ab408e-051b-41f8-8797-d5537be1217f: rpc.has_security_group_logging(os_id): False [ 1077.003786] env[65119]: INFO networking_nsxv3.common.synchronization [None req-8cfef5c2-af01-4805-9f80-253412120d7e tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1077.004435] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1077.006382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.006534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.006719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.006820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.006989] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.007109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.007164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.007412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.007412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.007553] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.022576] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.022755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.022791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.022985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.023119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.023454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.023575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.023649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.023813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.023894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.023982] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ab408e-051b-41f8-8797-d5537be1217f is going to be created. [ 1077.106160] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.106370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.106592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.106732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.107028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.132697] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: IN_PROGRESS for 2s [ 1077.163208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.163417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.163639] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.164778] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61304593-da90-44f4-89ff-7e23b4c97d2d with status ACTIVE [ 1077.165776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.165776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.165776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.165776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.165776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.165776] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.166190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.166190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.166190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.166190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.167972] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.167972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.167972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.167972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.167972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.167972] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61304593-da90-44f4-89ff-7e23b4c97d2d is going to be updated. [ 1077.191294] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.192713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.192713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.192713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.192713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.192713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61304593-da90-44f4-89ff-7e23b4c97d2d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.381448] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78855541-03b8-4d32-871e-c374cb44f414: rpc.has_security_group_logging(os_id): False [ 1077.400151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.400353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.400353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.400562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.400646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.400998] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.400998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.401149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.401239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.401302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.401483] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.401576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.401631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.401776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.401899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.402057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.402152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.402204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.402346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.402417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.402503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1077.512738] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.517310] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.517597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.517597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.518575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.518575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.543674] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1077.672637] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.022215] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.176492] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.176492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.176492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.176492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.176821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.176821] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d is going to be created. [ 1078.211907] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1078.212367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.221756] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.222030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.222030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.222309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.222509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.234736] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: UNINITIALIZED for 2s [ 1078.524833] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.525127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.525127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.525290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.525434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.525555] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1078.567324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.567536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.567616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.568123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.568123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.577984] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1079.055234] env[65119]: INFO networking_nsxv3.common.synchronization [req-7cca2576-57df-4fc7-b5a5-16c0b8deb1de req-b94cdb33-6a29-483b-b050-d5db0be4518c tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1079.055784] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1079.058326] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.058471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.058597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.058825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.059208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.059208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.059208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.059443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.059443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.059831] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.145190] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: SUCCESS [ 1079.145423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.558277] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1079.559308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.561601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.563026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.563026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.563026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.568309] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.568498] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.568621] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.568925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.569210] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.569410] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.569548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.569779] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.569924] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.570168] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.570288] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.570392] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.570512] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.570608] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.570711] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.570902] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.584307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.584566] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.584566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.584789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.584941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.585045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.585101] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1079.591918] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.592145] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.592261] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.592425] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.592731] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.592890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.593097] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.593421] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.593597] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1040af5-7a68-44b4-8aaf-7a05f9e371dc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.611905] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.612148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.612148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.612384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.612547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.621449] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1080.096185] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.096418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.096540] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.096818] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.096970] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.097149] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b1040af5-7a68-44b4-8aaf-7a05f9e371dc not found, creating... [ 1080.097410] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.097566] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.097685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.097914] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.098071] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.098354] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.098519] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.098638] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.098881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.099033] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.099176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b1040af5-7a68-44b4-8aaf-7a05f9e371dc is going to be created. [ 1080.120058] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.120311] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.120451] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.120721] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.121015] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.121302] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.248922] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: SUCCESS [ 1080.253463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.253686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.253930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.254216] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.254308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.254368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.254538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.254623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.254712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.254806] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.590440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1080.590892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.757124] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.902975] env[65119]: INFO networking_nsxv3.common.synchronization [req-afc8413f-69f0-4667-a358-ad482fa326fb req-541a2988-3560-4351-99fd-335b7a5020a1 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1080.903199] env[65119]: INFO networking_nsxv3.common.synchronization [req-afc8413f-69f0-4667-a358-ad482fa326fb req-541a2988-3560-4351-99fd-335b7a5020a1 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1080.903335] env[65119]: INFO networking_nsxv3.common.synchronization [req-afc8413f-69f0-4667-a358-ad482fa326fb req-541a2988-3560-4351-99fd-335b7a5020a1 service nova] Enqueued Resource ID: b1040af5-7a68-44b4-8aaf-7a05f9e371dc with Priority: HIGHEST for action port [ 1080.904033] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1080.904033] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1080.904158] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1040af5-7a68-44b4-8aaf-7a05f9e371dc with Priority: HIGHEST for action port [ 1080.904329] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.904448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.904584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.904791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.904863] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.905708] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.905883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.905928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.907908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.907908] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.907908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.907908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.907908] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1040af5-7a68-44b4-8aaf-7a05f9e371dc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.259898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13a91696-7519-44b6-b10f-fc41ed3e295d: rpc.has_security_group_logging(os_id): False [ 1081.279323] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.279565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.279565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.279836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.279836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.280072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.280180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.280240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.281392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.281527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.281628] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d is going to be created. [ 1081.342388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.342554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.342607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.343052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.343371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.353776] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: IN_PROGRESS for 2s [ 1081.409498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.409671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.409827] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.410829] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1040af5-7a68-44b4-8aaf-7a05f9e371dc with status ACTIVE [ 1081.411037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.411162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.411229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.411483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.411483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.411729] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.411814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.411814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.412029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.412119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.412255] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.412369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.412580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.412580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.412797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.412797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1040af5-7a68-44b4-8aaf-7a05f9e371dc is going to be updated. [ 1081.451627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.451780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.451908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.452188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.452337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.452503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1040af5-7a68-44b4-8aaf-7a05f9e371dc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.632164] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1081.632589] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e deletion is rescheduled due to dependency. [ 1081.632895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.914717] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.418665] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.419052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.419052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.419215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.419319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.419440] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1082.469422] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.469672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.469672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.469862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.470021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.479877] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1083.371933] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: SUCCESS [ 1083.372284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.496096] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1084.496461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.496523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.496794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.497050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.497187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.497255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.497443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.497522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.497608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.497709] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.000759] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.001066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.001150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.001383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.001564] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.001668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.001735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.001902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.002066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.002131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.002277] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.002394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.002434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.002580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.002726] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.002816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.003089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.003089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.003182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.003267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.007356] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.352080] env[65119]: INFO networking_nsxv3.common.synchronization [req-976e3884-6e92-4aa5-84d7-70f9f335d325 req-5e5d892e-e51a-48cd-a24f-181a1e324cd4 tempest-ServerActionsV293TestJSON-1222267651 tempest-ServerActionsV293TestJSON-1222267651-project-member] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1085.352578] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1085.352908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.353154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.353986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.353986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.354513] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.354761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.354830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.355047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.355337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.355463] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.512449] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2994e442-555a-4a06-b1c7-b7bebbd61b5f: rpc.has_security_group_logging(os_id): False [ 1085.532216] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.532825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.532825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.532825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.532962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.533461] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.533461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.533461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.534141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.534141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.534141] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.534263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.534263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.534644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.534644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.535052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.535052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.535052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.535516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.535516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.535516] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1085.602028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.602329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.602435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.602726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.602983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.618308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1085.859693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.859898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.860043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.860232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.860328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.860556] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.860643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.860687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.860836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.861029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.861137] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 already deleted. [ 1085.861228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.942155] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.942361] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-423" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.942485] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-423" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.942821] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-423" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.943096] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.943377] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.943455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.943685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.943831] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.944070] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.944154] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.944261] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.944366] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.944475] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.944626] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.944703] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.974259] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.974452] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.974629] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.974833] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-423" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.975098] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-efa21719-ca83-4c1b-b20a-1ba80d5f6818 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.975291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.975469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.976121] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.976285] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efa21719-ca83-4c1b-b20a-1ba80d5f6818',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.479544] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.479766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.479895] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.480221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.480377] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.480532] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port efa21719-ca83-4c1b-b20a-1ba80d5f6818 not found, creating... [ 1086.480782] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.480975] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.481119] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.481339] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.481475] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.481779] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.481957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.482100] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.482313] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.482453] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.482591] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: efa21719-ca83-4c1b-b20a-1ba80d5f6818 is going to be created. [ 1086.502792] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.503014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.503146] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.503419] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.503647] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.503915] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.231611] env[65119]: INFO networking_nsxv3.common.synchronization [req-976e3884-6e92-4aa5-84d7-70f9f335d325 req-71166259-24ae-4fbc-a8c5-b0fc8c09442e service nova] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1087.231927] env[65119]: INFO networking_nsxv3.common.synchronization [req-976e3884-6e92-4aa5-84d7-70f9f335d325 req-71166259-24ae-4fbc-a8c5-b0fc8c09442e service nova] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1087.232052] env[65119]: INFO networking_nsxv3.common.synchronization [req-976e3884-6e92-4aa5-84d7-70f9f335d325 req-71166259-24ae-4fbc-a8c5-b0fc8c09442e service nova] Enqueued Resource ID: efa21719-ca83-4c1b-b20a-1ba80d5f6818 with Priority: HIGHEST for action port [ 1087.232610] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_rules [ 1087.232749] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1087.232848] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efa21719-ca83-4c1b-b20a-1ba80d5f6818 with Priority: HIGHEST for action port [ 1087.233140] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.233297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.233331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.233508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.233608] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.235269] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.235426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.235498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.235673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.235824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.235921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.235984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.236212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.236212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.236314] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.237658] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-efa21719-ca83-4c1b-b20a-1ba80d5f6818 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.237868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.237868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.238759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.238759] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efa21719-ca83-4c1b-b20a-1ba80d5f6818',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.634149] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1087.634531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.700188] env[65119]: INFO networking_nsxv3.common.synchronization [req-05c33e9b-c77f-4ff0-b59a-0c85d5a756eb req-03278c7a-67f3-4a0e-a8e4-b7745d1567be tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1087.700877] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1087.702128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.702128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.702288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.702392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.702579] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.702682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.703030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.703030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.703120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.703180] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.740464] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.740804] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.740989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.741387] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efa21719-ca83-4c1b-b20a-1ba80d5f6818 with status ACTIVE [ 1087.741576] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.741697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.741780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.741989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.742112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.742306] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.742409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.742475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.742656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.742753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.742967] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.745459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.745531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.746125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.746125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.746125] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efa21719-ca83-4c1b-b20a-1ba80d5f6818 is going to be updated. [ 1087.768102] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.768284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.768683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.768683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.768783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.768951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efa21719-ca83-4c1b-b20a-1ba80d5f6818" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.206383] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.242173] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.399278] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.400232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.403493] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.403493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.403493] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.403493] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.403493] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.403493] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.403493] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.403493] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.403493] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.425497] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.425879] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.428018] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.428018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.428018] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-fbe85204-c098-4d38-9a16-3228674e2b70 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.428018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.428018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.428018] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.428018] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe85204-c098-4d38-9a16-3228674e2b70',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.708152] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.745974] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.746243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.748528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.748528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.748528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.748528] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 is going to be created. [ 1088.773040] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.774022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.774022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.774022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.774022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.783984] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: UNINITIALIZED for 2s [ 1088.799750] env[65119]: INFO networking_nsxv3.common.synchronization [None req-86ecd9cd-29fc-44f7-a435-3ec2eaaae613 None None] Enqueued Resource ID: b4ad9699-ff6e-4f54-8027-aa2a1cd920e9 with Priority: HIGHEST for action port [ 1088.800382] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ad9699-ff6e-4f54-8027-aa2a1cd920e9 with Priority: HIGHEST for action port [ 1088.800731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4ad9699-ff6e-4f54-8027-aa2a1cd920e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.800862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4ad9699-ff6e-4f54-8027-aa2a1cd920e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.800928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4ad9699-ff6e-4f54-8027-aa2a1cd920e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.801337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4ad9699-ff6e-4f54-8027-aa2a1cd920e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.801423] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4ad9699-ff6e-4f54-8027-aa2a1cd920e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.930607] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.930854] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.931499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.931499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.931499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.931749] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port fbe85204-c098-4d38-9a16-3228674e2b70 not found, creating... [ 1088.931923] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.932194] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.932377] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.932624] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.932801] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.933480] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.933684] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.933821] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.934136] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.934322] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.934519] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: fbe85204-c098-4d38-9a16-3228674e2b70 is going to be created. [ 1088.959501] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.959651] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.959785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.960209] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.960475] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.961036] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.211467] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.211467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.211467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.211467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.211670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.211670] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1089.242150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.242290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.242506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.242558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.242717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.254901] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1089.306400] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4ad9699-ff6e-4f54-8027-aa2a1cd920e9 [ 1089.306643] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.306780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.306851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.307089] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.307185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.307280] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4ad9699-ff6e-4f54-8027-aa2a1cd920e9 already deleted. [ 1089.307362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4ad9699-ff6e-4f54-8027-aa2a1cd920e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.677520] env[65119]: INFO networking_nsxv3.common.synchronization [req-05c33e9b-c77f-4ff0-b59a-0c85d5a756eb req-7aa87df0-2c74-45c6-a6b0-f075d915a22e service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1089.677702] env[65119]: INFO networking_nsxv3.common.synchronization [req-05c33e9b-c77f-4ff0-b59a-0c85d5a756eb req-7aa87df0-2c74-45c6-a6b0-f075d915a22e service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1089.677841] env[65119]: INFO networking_nsxv3.common.synchronization [req-05c33e9b-c77f-4ff0-b59a-0c85d5a756eb req-7aa87df0-2c74-45c6-a6b0-f075d915a22e service nova] Enqueued Resource ID: fbe85204-c098-4d38-9a16-3228674e2b70 with Priority: HIGHEST for action port [ 1089.678408] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1089.678545] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1089.679349] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe85204-c098-4d38-9a16-3228674e2b70 with Priority: HIGHEST for action port [ 1089.680886] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.681121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.681196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.681406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.681488] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.682999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.683073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.684934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe85204-c098-4d38-9a16-3228674e2b70 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.684934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.684934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.684934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.684934] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe85204-c098-4d38-9a16-3228674e2b70',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.187987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.187987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.187987] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbe85204-c098-4d38-9a16-3228674e2b70 with status ACTIVE [ 1090.187987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.187987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.187987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.188374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.188374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.188717] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.188811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.188850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.189051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.189104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.190497] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.190497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.190497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.190497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.190497] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.190497] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbe85204-c098-4d38-9a16-3228674e2b70 is going to be updated. [ 1090.227822] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.227822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.227822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.227822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.227967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.228099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe85204-c098-4d38-9a16-3228674e2b70" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.273538] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c63d1aab-2fc1-4227-a89d-01fb37fef490 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1090.276942] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1090.278536] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.278677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.278745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.279036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.279120] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.414643] env[65119]: INFO networking_nsxv3.common.synchronization [None req-cb8bbb45-5c9a-4b52-abc6-e8b54b17acf7 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1090.414643] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1090.414643] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.414761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.796957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: UNINITIALIZED for 4s [ 1090.807567] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.807761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.807812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.808026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.808118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.808214] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 already deleted. [ 1090.808298] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.808450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.808601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.808857] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.267485] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1091.267765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.267977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.268281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.268708] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.268708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.268708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.268937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.269058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.269148] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.341549] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.341549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.341549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.341549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.341549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.341549] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 already deleted. [ 1091.341549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.772719] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.798155] env[65119]: INFO networking_nsxv3.common.synchronization [None req-b05d999d-d04e-4fcd-94dd-a0dbfae4ed8d None None] Enqueued Resource ID: c049bd72-4fdf-47d0-ab59-d8a0d342ae12 with Priority: HIGHEST for action port [ 1091.801494] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c049bd72-4fdf-47d0-ab59-d8a0d342ae12 with Priority: HIGHEST for action port [ 1091.801494] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c049bd72-4fdf-47d0-ab59-d8a0d342ae12 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.801494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c049bd72-4fdf-47d0-ab59-d8a0d342ae12" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.801494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c049bd72-4fdf-47d0-ab59-d8a0d342ae12" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.801494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c049bd72-4fdf-47d0-ab59-d8a0d342ae12" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.801494] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c049bd72-4fdf-47d0-ab59-d8a0d342ae12',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.276773] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.303813] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c049bd72-4fdf-47d0-ab59-d8a0d342ae12 [ 1092.304058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.304198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.304261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.304511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.304594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.304705] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c049bd72-4fdf-47d0-ab59-d8a0d342ae12 already deleted. [ 1092.304772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c049bd72-4fdf-47d0-ab59-d8a0d342ae12" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.779425] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.779425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.779425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.779821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.779821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.779821] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1092.943235] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: SUCCESS [ 1092.943598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.943818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.944074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.944678] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.944678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.944678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.944960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.944960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.944960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.944960] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.962327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.962483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.962564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.962836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.963073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.978325] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1093.447577] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.951141] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac0d43e6-6e39-462f-b009-edd165ae1d99: rpc.has_security_group_logging(os_id): False [ 1093.971257] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.971507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.971621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.971871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.971987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.972272] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.972381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.972447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.972606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.972684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.972775] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 is going to be created. [ 1094.046041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.046041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.046041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.046041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.046277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.060213] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: IN_PROGRESS for 2s [ 1094.831394] env[65119]: INFO networking_nsxv3.common.synchronization [None req-40e8f9fb-a297-400a-8baf-2ab626f13fc3 None None] Enqueued Resource ID: dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8 with Priority: HIGHEST for action port [ 1094.831830] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8 with Priority: HIGHEST for action port [ 1094.832595] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.832732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.832801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.833785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.836181] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.990449] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.990449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.990449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.990449] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.081423] env[65119]: INFO networking_nsxv3.common.synchronization [req-d8245c61-39d7-4257-b5e9-010686ec1c56 req-5de341c1-8086-4911-a05a-f8f6e307e984 tempest-InstanceActionsNegativeTestJSON-288861138 tempest-InstanceActionsNegativeTestJSON-288861138-project-member] Enqueued Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1095.082029] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1095.082394] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.082524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.082614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.082903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.083102] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.083234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.083303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.083494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.083585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.083703] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.338559] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8 [ 1095.338804] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.338944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.339038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.339367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.339410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.339692] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8 already deleted. [ 1095.339801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd1e4179-523e-4d54-b9a2-ea2f35a5b0b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.468300] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.468503] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-442" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-442" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-442" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.473023] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.473023] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.473023] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.473023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.473023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.473023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.473023] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.473023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.473023] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.494038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.494038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.494038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.494038] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.494038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.494740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.494740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.494740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.494740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.495082] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.497358] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.500227] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.500227] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.500227] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-442" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.500227] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-8de7150a-f2c9-4513-acdd-99225c023ea3 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.503185] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.503185] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.503185] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.503185] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de7150a-f2c9-4513-acdd-99225c023ea3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.586242] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.586408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.586474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.586696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.586788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.586983] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.587095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.587149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.587349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.587564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.587681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 already deleted. [ 1095.587771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.005332] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1096.007497] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.007771] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.007989] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.008527] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.008670] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.009605] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 8de7150a-f2c9-4513-acdd-99225c023ea3 not found, creating... [ 1096.009605] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.009605] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.009605] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.009763] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.009802] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.010058] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.010239] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.010338] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.010755] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.010890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.011054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 8de7150a-f2c9-4513-acdd-99225c023ea3 is going to be created. [ 1096.032034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.032034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.032034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.032034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.032653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.032653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.032653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.032653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.032653] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1096.037167] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.037375] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.037499] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.037746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.037971] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.038232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.075757] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: SUCCESS [ 1096.075757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.119839] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.120021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.120057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.120276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.120425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.152159] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1096.743985] env[65119]: INFO networking_nsxv3.common.synchronization [req-d8245c61-39d7-4257-b5e9-010686ec1c56 req-31260051-6fdc-4f74-bdf1-933170e42efe service nova] Enqueued Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_rules [ 1096.744155] env[65119]: INFO networking_nsxv3.common.synchronization [req-d8245c61-39d7-4257-b5e9-010686ec1c56 req-31260051-6fdc-4f74-bdf1-933170e42efe service nova] Enqueued Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1096.744284] env[65119]: INFO networking_nsxv3.common.synchronization [req-d8245c61-39d7-4257-b5e9-010686ec1c56 req-31260051-6fdc-4f74-bdf1-933170e42efe service nova] Enqueued Resource ID: 8de7150a-f2c9-4513-acdd-99225c023ea3 with Priority: HIGHEST for action port [ 1096.744845] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_rules [ 1096.744938] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1096.745523] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de7150a-f2c9-4513-acdd-99225c023ea3 with Priority: HIGHEST for action port [ 1096.745951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.746672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.746837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.747168] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.747462] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.748567] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.748706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.748974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.749103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.749805] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.749805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.751178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.751178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.751178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.751178] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.752517] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de7150a-f2c9-4513-acdd-99225c023ea3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.752517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.752517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.752517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.752517] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de7150a-f2c9-4513-acdd-99225c023ea3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.254547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.254845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.254939] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.257567] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de7150a-f2c9-4513-acdd-99225c023ea3 with status ACTIVE [ 1097.257873] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.258088] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.258433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.258712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.258996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.259348] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.259850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.259850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.259850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.259850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.260103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.260427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.260427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.260588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.260721] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.260868] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de7150a-f2c9-4513-acdd-99225c023ea3 is going to be updated. [ 1097.303710] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.303880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.303880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.304092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.304235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.304405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de7150a-f2c9-4513-acdd-99225c023ea3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.563120] env[65119]: INFO networking_nsxv3.common.synchronization [None req-2daf4c63-dc7c-43a4-b5d3-b1137527ad7d None None] Enqueued Resource ID: 4b743e29-51f9-40bb-a9c3-2db564c42621 with Priority: HIGHEST for action port [ 1097.564404] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b743e29-51f9-40bb-a9c3-2db564c42621 with Priority: HIGHEST for action port [ 1097.564997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b743e29-51f9-40bb-a9c3-2db564c42621 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.565157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b743e29-51f9-40bb-a9c3-2db564c42621" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.565270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b743e29-51f9-40bb-a9c3-2db564c42621" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.565715] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b743e29-51f9-40bb-a9c3-2db564c42621" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.565715] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b743e29-51f9-40bb-a9c3-2db564c42621',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.699147] env[65119]: INFO networking_nsxv3.common.synchronization [req-44c07aaa-18af-43e5-af02-57756b11c8d0 req-d42eb22d-36cf-4368-9fac-9c4ae4c27544 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1097.699650] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1097.699957] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.700179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.700179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.700357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.700507] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.700604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.700666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.700810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.700895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.700989] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.756582] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.798694] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43e6686a-f5da-4dc0-bfc9-e7cd78d3a031 None None] Enqueued Resource ID: 4d1a0e1e-950a-4d47-907a-cc03466891b8 with Priority: HIGHEST for action port [ 1097.799395] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d1a0e1e-950a-4d47-907a-cc03466891b8 with Priority: HIGHEST for action port [ 1097.800060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d1a0e1e-950a-4d47-907a-cc03466891b8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.800199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d1a0e1e-950a-4d47-907a-cc03466891b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.800269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d1a0e1e-950a-4d47-907a-cc03466891b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.800519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d1a0e1e-950a-4d47-907a-cc03466891b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.800607] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d1a0e1e-950a-4d47-907a-cc03466891b8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.071436] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b743e29-51f9-40bb-a9c3-2db564c42621 [ 1098.071981] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.071981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.071981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.072206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.072206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.072344] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b743e29-51f9-40bb-a9c3-2db564c42621 already deleted. [ 1098.072432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b743e29-51f9-40bb-a9c3-2db564c42621" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.086436] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.086436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.086436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.086436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.086436] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.086436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.086436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.087288] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.087468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.087924] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.087924] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.087924] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.088169] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.088169] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.088910] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.088910] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.109691] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.109691] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.109691] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.109691] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.109914] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b152ad6e-67b9-4f6c-8f44-2d943b044769 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.110075] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.110373] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.111162] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.111863] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b152ad6e-67b9-4f6c-8f44-2d943b044769',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.166908] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1098.167433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.204422] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.204818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.204818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.204916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.204949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.205182] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.205297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.205343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.205501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.205575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.205911] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1098.236923] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.237102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.237178] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.237386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.237535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.248701] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1098.261264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.261264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.261264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.261264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.261732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.261732] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 is going to be created. [ 1098.293124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.293309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.293360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.293558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.293708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.303992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: UNINITIALIZED for 2s [ 1098.304196] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d1a0e1e-950a-4d47-907a-cc03466891b8 [ 1098.304399] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.304607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.304607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.304831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.305524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.305836] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d1a0e1e-950a-4d47-907a-cc03466891b8 already deleted. [ 1098.306370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d1a0e1e-950a-4d47-907a-cc03466891b8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.614197] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.614469] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.614636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.614964] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.615193] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.615417] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b152ad6e-67b9-4f6c-8f44-2d943b044769 not found, creating... [ 1098.615739] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.616435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.616435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.616435] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.616590] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.616952] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.617360] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.617399] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.619021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.619021] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.619021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 is going to be created. [ 1098.642414] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.642658] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.642797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.643491] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.643491] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.643615] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.955514] env[65119]: INFO networking_nsxv3.common.synchronization [req-c83a916e-3170-4b3f-b7a4-2b1e85694159 req-20660c71-f5df-4295-ab3e-263786a3358a tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1098.956095] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1098.956095] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.956485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.956485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.956576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.956893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.956893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.956893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.957052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.957133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.957208] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [req-44c07aaa-18af-43e5-af02-57756b11c8d0 req-7cc95867-5461-4ca8-aa58-25e6d11edf94 service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [req-44c07aaa-18af-43e5-af02-57756b11c8d0 req-7cc95867-5461-4ca8-aa58-25e6d11edf94 service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [req-44c07aaa-18af-43e5-af02-57756b11c8d0 req-7cc95867-5461-4ca8-aa58-25e6d11edf94 service nova] Enqueued Resource ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 with Priority: HIGHEST for action port [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1099.391507] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 with Priority: HIGHEST for action port [ 1099.398019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.398019] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.398019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.398019] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b152ad6e-67b9-4f6c-8f44-2d943b044769 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.398019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.398019] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b152ad6e-67b9-4f6c-8f44-2d943b044769',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.462623] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.556755] env[65119]: INFO networking_nsxv3.common.synchronization [None req-f65ac73d-a8d7-4206-a000-4c9d1f6dee4d tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1099.557798] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1099.558060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.558419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.898899] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.898899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.900328] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b152ad6e-67b9-4f6c-8f44-2d943b044769 with status ACTIVE [ 1099.903050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.903050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.903050] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.903050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.903050] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 is going to be updated. [ 1099.927497] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.928037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.928099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.928324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.928447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.928617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.963526] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.108566] env[65119]: INFO networking_nsxv3.common.synchronization [req-64d81938-7760-4467-89aa-101e01b7c122 req-2d34c747-bfd1-40c6-9c5c-0b7761209232 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1100.109385] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1100.109817] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.109936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.110070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.110316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.110483] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.110631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.110695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.110891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.110991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.111159] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.262345] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1100.262645] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e deletion is rescheduled due to dependency. [ 1100.263085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.263521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.263834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.264075] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.264207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.264277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.264445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.264530] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.264632] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.315104] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: SUCCESS [ 1100.315291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.315453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.315659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.315851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.315971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.316050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.316209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.316291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.316375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.316461] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.437128] env[65119]: INFO networking_nsxv3.common.synchronization [None req-647708f2-0f20-4c97-a34b-1c4e7699ebdc None None] Enqueued Resource ID: e99a9b08-33e5-4659-9817-1ee23c0f3f03 with Priority: HIGHEST for action port [ 1100.437128] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a9b08-33e5-4659-9817-1ee23c0f3f03 with Priority: HIGHEST for action port [ 1100.437128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e99a9b08-33e5-4659-9817-1ee23c0f3f03 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.437128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e99a9b08-33e5-4659-9817-1ee23c0f3f03" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.437128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e99a9b08-33e5-4659-9817-1ee23c0f3f03" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.437128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e99a9b08-33e5-4659-9817-1ee23c0f3f03" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.437128] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99a9b08-33e5-4659-9817-1ee23c0f3f03',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.467330] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.467330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.467330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.467471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.467471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.467683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1100.501157] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.501869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.502568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.502667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.502879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.517194] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1100.567163] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.567391] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.567455] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.567710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.568820] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.569129] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.569271] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.569517] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.569664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.569924] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.570068] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.570195] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.570338] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.570765] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.570765] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.570882] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.597634] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.599103] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.599103] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.599103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.599103] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.599103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.599103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.599103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.599355] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cada3e5b-d932-4cfe-9ce7-fa1281c8068d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.614022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.614216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.614289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.614500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.614592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.614819] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.614926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.615065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.615220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.615383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.615476] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 already deleted. [ 1100.615561] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.771886] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.824020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.824020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.824020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.824020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.824020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.824581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.824581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.824581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.824581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.824581] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.940526] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e99a9b08-33e5-4659-9817-1ee23c0f3f03 [ 1100.940526] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.940526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.940526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.940902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.941047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.941155] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e99a9b08-33e5-4659-9817-1ee23c0f3f03 already deleted. [ 1100.941269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e99a9b08-33e5-4659-9817-1ee23c0f3f03" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.105299] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.105543] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.105664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.105921] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.106087] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.106244] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port cada3e5b-d932-4cfe-9ce7-fa1281c8068d not found, creating... [ 1101.106507] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.106670] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.106849] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.107012] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.107157] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.107481] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.107576] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.107710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.107899] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.110125] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.110353] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: cada3e5b-d932-4cfe-9ce7-fa1281c8068d is going to be created. [ 1101.137949] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.138274] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.138424] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.138737] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.139013] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.139278] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.274435] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.330773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11640dd0-f616-4c88-b27a-efd2c41b9114: rpc.has_security_group_logging(os_id): False [ 1101.362418] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.362612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.362659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.362877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.362985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.364064] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.364064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.364064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.364064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.364064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.364301] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.365058] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.365058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.365311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.365311] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.365361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 is going to be created. [ 1101.437897] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.438236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.438236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.438355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.438528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.458679] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: IN_PROGRESS for 2s [ 1101.781547] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.781547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.781547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.781820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.781820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.781820] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1101.817013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.817177] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.817275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.817489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.817634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.826299] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1101.864453] env[65119]: INFO networking_nsxv3.common.synchronization [req-64d81938-7760-4467-89aa-101e01b7c122 req-bc5d3a7d-55bc-483d-be5c-a9d79db6457d service nova] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1101.864644] env[65119]: INFO networking_nsxv3.common.synchronization [req-64d81938-7760-4467-89aa-101e01b7c122 req-bc5d3a7d-55bc-483d-be5c-a9d79db6457d service nova] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1101.864782] env[65119]: INFO networking_nsxv3.common.synchronization [req-64d81938-7760-4467-89aa-101e01b7c122 req-bc5d3a7d-55bc-483d-be5c-a9d79db6457d service nova] Enqueued Resource ID: cada3e5b-d932-4cfe-9ce7-fa1281c8068d with Priority: HIGHEST for action port [ 1101.865434] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_rules [ 1101.865587] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1101.865689] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cada3e5b-d932-4cfe-9ce7-fa1281c8068d with Priority: HIGHEST for action port [ 1101.866022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.866645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.866645] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.866866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.866964] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.868063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.869244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.869244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.869244] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.870220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.870536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.870536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.870662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.870662] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cada3e5b-d932-4cfe-9ce7-fa1281c8068d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.372440] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.372610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.372807] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.374503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cada3e5b-d932-4cfe-9ce7-fa1281c8068d with status ACTIVE [ 1102.374710] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.374848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.374919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.375255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.375327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.375567] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.375646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.375677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.375903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.376014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.376266] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.376375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.376427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.376578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.376656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.376741] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cada3e5b-d932-4cfe-9ce7-fa1281c8068d is going to be updated. [ 1102.398027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.398027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.398027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.398027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.398027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.398027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cada3e5b-d932-4cfe-9ce7-fa1281c8068d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.412799] env[65119]: INFO networking_nsxv3.common.synchronization [req-c61cf853-6ed8-4dc3-a401-25769e87dffe req-f95376a3-de4c-4ba0-aa38-156021064151 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1102.413521] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGHEST for action security_group_members [ 1102.413849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.413963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.414063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.414299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.414468] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.414569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.414623] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.415919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.415919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.415919] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.528576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1102.528576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.528901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.528901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.529391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.529391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.529391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.529552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.529552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.529622] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.875368] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.917391] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.917541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.917614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.917844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.917933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.918236] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.918382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.918382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.918556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.918688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.918827] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff is going to be updated. [ 1102.955747] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.957610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.957711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.957910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.958111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.968754] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: IN_PROGRESS for 2s [ 1103.032032] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.032032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.032032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.032498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.032498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.032602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.032754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.032890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.033036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.033143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.033255] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1103.063592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.063856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.063856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.064223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.064335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.074532] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1103.377514] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.377683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.377757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.377968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.378078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.378178] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 is going to be created. [ 1103.400635] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.400828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.400940] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.401265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.401438] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.417478] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: UNINITIALIZED for 2s [ 1103.482222] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: SUCCESS [ 1103.482325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.798417] env[65119]: INFO networking_nsxv3.common.synchronization [req-391c472f-869d-432d-b66c-ff675f7bd252 req-ff84d893-32d2-4c2d-a2e8-c460d6e57afe tempest-ServersNegativeTestMultiTenantJSON-390040831 tempest-ServersNegativeTestMultiTenantJSON-390040831-project-member] Enqueued Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1103.799079] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1103.799535] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.799717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.799829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.800204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.800440] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.800597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.800719] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.800978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.801181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.801302] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.840072] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.840072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.840072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.840072] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.141089] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.141417] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.142445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.142445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.142445] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.142445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.142445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.142991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.143099] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.143316] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.143428] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.143536] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.143641] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.143748] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.143851] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.144112] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.165051] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.165255] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.165447] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.165654] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-362" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.166032] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-405c5672-dc3a-475e-9151-c439f70af9db taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.166232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.166508] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.166819] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.167028] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('405c5672-dc3a-475e-9151-c439f70af9db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.309193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.309193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.309193] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 already deleted. [ 1104.309193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.344049] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.672022] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.672022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 405c5672-dc3a-475e-9151-c439f70af9db not found, creating... [ 1104.672022] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.672022] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.672577] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.672577] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.672577] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.672924] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.673097] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.673252] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 405c5672-dc3a-475e-9151-c439f70af9db is going to be created. [ 1104.697906] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.698318] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.698502] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.698852] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.699449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.699449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.846390] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cec5d72a-5222-4ea2-bb61-5a248eace68e: rpc.has_security_group_logging(os_id): False [ 1104.867702] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.867990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.867990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.868170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.868255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.868593] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.868824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.868909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.869149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.869246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.869359] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1104.982054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.982054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.982054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.982054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.982054] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.984598] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff in Status: SUCCESS [ 1104.984766] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff deletion is rescheduled due to dependency. [ 1104.984877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.998087] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1105.085554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1105.085748] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f deletion is rescheduled due to dependency. [ 1105.085810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429276] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: SUCCESS [ 1105.429276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.429276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.429276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.429276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.429276] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.429672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.429672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429672] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.442625] env[65119]: INFO networking_nsxv3.common.synchronization [req-391c472f-869d-432d-b66c-ff675f7bd252 req-ce2efa28-1839-47a7-b05a-6e62457ec12f service nova] Enqueued Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_rules [ 1105.442805] env[65119]: INFO networking_nsxv3.common.synchronization [req-391c472f-869d-432d-b66c-ff675f7bd252 req-ce2efa28-1839-47a7-b05a-6e62457ec12f service nova] Enqueued Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1105.442940] env[65119]: INFO networking_nsxv3.common.synchronization [req-391c472f-869d-432d-b66c-ff675f7bd252 req-ce2efa28-1839-47a7-b05a-6e62457ec12f service nova] Enqueued Resource ID: 405c5672-dc3a-475e-9151-c439f70af9db with Priority: HIGHEST for action port [ 1105.443488] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_rules [ 1105.443709] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1105.443865] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 405c5672-dc3a-475e-9151-c439f70af9db with Priority: HIGHEST for action port [ 1105.444457] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.444605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.444678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.444926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.445022] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.446098] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.446600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.446759] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.447071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.447150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.447238] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.448934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-405c5672-dc3a-475e-9151-c439f70af9db taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.448934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.448934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.448934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.449141] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('405c5672-dc3a-475e-9151-c439f70af9db',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.932951] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.951286] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.955319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.955319] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 405c5672-dc3a-475e-9151-c439f70af9db with status ACTIVE [ 1105.955319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.955319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.955319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.955319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.955898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.955898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.955898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.955898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.955898] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 405c5672-dc3a-475e-9151-c439f70af9db is going to be updated. [ 1105.979756] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.979756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.979955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.981164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.981164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.981164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-405c5672-dc3a-475e-9151-c439f70af9db" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.213441] env[65119]: INFO networking_nsxv3.common.synchronization [req-be907e56-b64e-48af-b64a-ecae68bff197 req-ca473e28-3626-4fe3-9d01-051639264dc6 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1106.213965] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1106.214290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.214416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.214496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.214697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.214849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.214946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.215015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.215162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.215265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.215337] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.436316] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7705f38-2e46-4cc6-a745-b9fed998f2e9: rpc.has_security_group_logging(os_id): False [ 1106.459024] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.464662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.464662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.464662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.464662] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 is going to be created. [ 1106.528352] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.528554] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.528676] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.528957] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.529268] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.529428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.529549] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.530510] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.530510] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.530510] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.530510] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.530510] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.530510] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.530741] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.530741] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.530803] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.532628] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.532739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.532808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.533180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.533180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.544154] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: IN_PROGRESS for 2s [ 1106.559252] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.559523] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.559704] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.559905] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.560392] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-33581050-2fd6-4acb-88a1-6bbca2deab0b taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.560620] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.560750] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.561348] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.561579] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33581050-2fd6-4acb-88a1-6bbca2deab0b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.786561] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.960792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.961242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.961242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.961329] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.961396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.961503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 is going to be created. [ 1106.987048] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.987253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.987303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.987474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.987633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.999546] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: UNINITIALIZED for 2s [ 1107.015485] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1107.016159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.064283] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.064550] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.064681] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.064972] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.065165] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.065338] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 33581050-2fd6-4acb-88a1-6bbca2deab0b not found, creating... [ 1107.065607] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.065765] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.065884] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.066139] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.066281] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.066565] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.066724] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.066843] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.067066] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.067203] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.067346] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 33581050-2fd6-4acb-88a1-6bbca2deab0b is going to be created. [ 1107.089208] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.089635] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.089777] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.090101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.090326] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.090548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.289028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.791139] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.791461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.791583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.791822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.791916] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.792034] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1107.842211] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.842211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.842211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.842211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.842211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.859854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1107.863435] env[65119]: INFO networking_nsxv3.common.synchronization [req-be907e56-b64e-48af-b64a-ecae68bff197 req-fe778fb4-8cc6-4778-91ac-fc26c3f3a705 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1107.863569] env[65119]: INFO networking_nsxv3.common.synchronization [req-be907e56-b64e-48af-b64a-ecae68bff197 req-fe778fb4-8cc6-4778-91ac-fc26c3f3a705 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1107.863804] env[65119]: INFO networking_nsxv3.common.synchronization [req-be907e56-b64e-48af-b64a-ecae68bff197 req-fe778fb4-8cc6-4778-91ac-fc26c3f3a705 service nova] Enqueued Resource ID: 33581050-2fd6-4acb-88a1-6bbca2deab0b with Priority: HIGHEST for action port [ 1107.865024] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1107.865205] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1107.865341] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33581050-2fd6-4acb-88a1-6bbca2deab0b with Priority: HIGHEST for action port [ 1107.865666] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.865842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.865921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.866191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.866295] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.868053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.868206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.868488] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-33581050-2fd6-4acb-88a1-6bbca2deab0b taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.868624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.868701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.870087] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.870087] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33581050-2fd6-4acb-88a1-6bbca2deab0b',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.341029] env[65119]: INFO networking_nsxv3.common.synchronization [req-03fcf5e2-7d4e-453e-a7ae-ce6e5f7c07fd req-53ce8f30-cec3-4e25-a4d5-34b5fb8ffafb tempest-InstanceActionsNegativeTestJSON-288861138 tempest-InstanceActionsNegativeTestJSON-288861138-project-member] Enqueued Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1108.341391] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGHEST for action security_group_members [ 1108.341637] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.341752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.341824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.342086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.342266] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.342386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.342450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.342649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.342731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.342828] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.370536] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.370773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.371475] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33581050-2fd6-4acb-88a1-6bbca2deab0b with status ACTIVE [ 1108.371475] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.371629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.371667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.372066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.372066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.372251] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.372418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.372454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.372640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.372728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.372914] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.373061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.373135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.373330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.373439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.374101] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33581050-2fd6-4acb-88a1-6bbca2deab0b is going to be updated. [ 1108.396513] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.396667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.396745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.396947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.397100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.397263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33581050-2fd6-4acb-88a1-6bbca2deab0b" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.508309] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0bc6daa6-a38e-4891-a0a8-53fe33d99dd1 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1108.508563] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1108.508890] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.509123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.509366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.509529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.509621] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.559502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: SUCCESS [ 1108.560244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.701458] env[65119]: INFO networking_nsxv3.common.synchronization [None req-16763d46-8762-44b3-95cb-63054334c7a0 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1108.701996] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1108.702498] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.702498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.845893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.845893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.845893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.846399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.846399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.846691] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.846691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.846691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.846829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.846829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.846957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 is going to be updated. [ 1108.890023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.890174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.890174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.891119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.891119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.904668] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: IN_PROGRESS for 2s [ 1109.012314] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: SUCCESS [ 1109.012663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.012953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.013305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.013595] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.013769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.013870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.014147] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.014426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.014690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.014842] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.059233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.059428] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.059469] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.059709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.059796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.059897] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 already deleted. [ 1109.060000] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.060595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.060778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.060867] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.518535] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.519207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.519207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.519207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.519207] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.519475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.519475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.519475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.519590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.519651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.519805] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.520092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.520201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.520354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.520494] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.520590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.520653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.520789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.520864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.520961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.521040] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.582640] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.582976] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.583074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.583565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.583820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.584421] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 already deleted. [ 1109.584506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.870620] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1109.870853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.871039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.871330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.871527] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.871669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.871760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.871861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.871932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.872134] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.024270] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52301c55-2aed-492e-b8aa-01f9cb12dce6: rpc.has_security_group_logging(os_id): False [ 1110.041507] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.041659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.041733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.041949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.042051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.042268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.042385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.042464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.042624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.042701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.042884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.042980] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.043057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.043197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.043273] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.043450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.043585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.043640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.043776] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.043852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.043938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 is going to be created. [ 1110.108373] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.108532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.108605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.108810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.108985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.125065] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: IN_PROGRESS for 2s [ 1110.374021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.877211] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.913825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 in Status: SUCCESS [ 1110.914041] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 deletion is rescheduled due to dependency. [ 1110.914140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.379848] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.379848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.379848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.379848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.379848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.379848] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1111.416023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.416179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.416255] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.416941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.416941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.425681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1112.137063] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: SUCCESS [ 1112.137386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.437126] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1113.437404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.437717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.437835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.438097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.438254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.438340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.438590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.438691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.438779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.438876] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.702804] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.702960] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1113.941080] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.941307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.941439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.941817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.942076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.942232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.942325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.942610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.942712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.942848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.943125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.943292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.943410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.943686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.943925] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.944086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.944242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.944514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.944671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.944798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.944920] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.447992] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1114.465479] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.465671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.465747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.465963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.466069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.466301] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.466458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.466458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.466617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.466718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.466865] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.466958] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.467027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.467164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.467238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.467431] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.467510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.467565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.467700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.467788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.467872] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1114.529952] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.530141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.530240] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.530516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.530691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.544350] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1115.016815] env[65119]: INFO networking_nsxv3.common.synchronization [req-130d7e6e-fd38-452e-a6cc-bfb28a46898d req-cac286c9-e014-472e-8896-c98a49c4987e tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1115.017424] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1115.017742] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.017868] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.017936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.018207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.018616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.018616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.018616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.018805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.018805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.018857] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.314657] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.314934] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.315083] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.315349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.315671] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.315924] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.316051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.316323] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.316413] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.316621] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.316734] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.316854] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.316947] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.317084] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.317196] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.317329] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.338746] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.338909] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.339068] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.339254] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.339793] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.339793] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.339944] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.340211] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.340355] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b7f0bb-1ca1-4e72-8d29-8ff8533da495',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.520684] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.521117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.521117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.521187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.521243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.521483] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.521634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.521684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.521867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.521978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.522095] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 already deleted. [ 1115.522200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.875969] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.876236] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.876354] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.876630] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.876778] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.876946] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 not found, creating... [ 1115.877227] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.877434] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.877524] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.877710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.877932] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.878240] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.878565] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.878565] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.878866] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.878866] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.879027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 is going to be created. [ 1115.906497] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.906788] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.906846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.907156] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.907401] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.907686] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.558586] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1116.558907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.634163] env[65119]: INFO networking_nsxv3.common.synchronization [req-130d7e6e-fd38-452e-a6cc-bfb28a46898d req-883f81ec-eca4-4137-b458-807790d58e44 service nova] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1116.634430] env[65119]: INFO networking_nsxv3.common.synchronization [req-130d7e6e-fd38-452e-a6cc-bfb28a46898d req-883f81ec-eca4-4137-b458-807790d58e44 service nova] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1116.634665] env[65119]: INFO networking_nsxv3.common.synchronization [req-130d7e6e-fd38-452e-a6cc-bfb28a46898d req-883f81ec-eca4-4137-b458-807790d58e44 service nova] Enqueued Resource ID: 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 with Priority: HIGHEST for action port [ 1116.635827] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1116.635961] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1116.636132] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 with Priority: HIGHEST for action port [ 1116.636428] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.636553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.636621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.636819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.636903] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.637936] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.637936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.638081] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.638767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.638767] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.638767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.638767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.638767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.638767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.638767] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.639655] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.639790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.640069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.640163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.640302] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b7f0bb-1ca1-4e72-8d29-8ff8533da495',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.142706] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.142805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 with status ACTIVE [ 1117.143170] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.143274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.143330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.143537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.143619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.143785] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.143877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.143936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.144092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.144163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.144343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.144431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.144487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.144621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.144690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.145748] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54b7f0bb-1ca1-4e72-8d29-8ff8533da495 is going to be updated. [ 1117.145977] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.166854] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.166957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.167014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.167231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.168222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.168222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b7f0bb-1ca1-4e72-8d29-8ff8533da495" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.559477] env[65119]: INFO networking_nsxv3.common.synchronization [req-71aac51c-c8a2-4abb-b2ec-4c09498b575d req-14723ae5-8dac-491e-909c-48a0f880d90d tempest-ServersNegativeTestMultiTenantJSON-390040831 tempest-ServersNegativeTestMultiTenantJSON-390040831-project-member] Enqueued Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1117.559477] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGHEST for action security_group_members [ 1117.559739] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.559739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.559822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.560026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.560195] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.560297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.560355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.560555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.560589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.560676] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.648331] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.064742] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.064928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.065294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.065294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.065294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.065489] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.065584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.065646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.065789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.065864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.065972] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 is going to be updated. [ 1118.094818] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.095027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.095027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.095229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.095378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.112099] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: IN_PROGRESS for 2s [ 1118.151899] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.152138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.152138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.152265] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.152356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.152612] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be created. [ 1118.176568] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.176779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.176779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.177027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.177221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.188543] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: UNINITIALIZED for 2s [ 1119.529378] env[65119]: INFO networking_nsxv3.common.synchronization [req-cec09e98-5c8b-423b-8d63-e86d4fc5c081 req-9c536fda-e496-4046-8d31-3d8a57af6572 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1119.529914] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1119.530241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.530361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.530433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.530627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.530783] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.530881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.530945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.531112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.531195] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.531291] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.033989] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.122611] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 in Status: SUCCESS [ 1120.122816] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 deletion is rescheduled due to dependency. [ 1120.122952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.197060] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1120.197289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.197490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.197738] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.197978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.198107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.198188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.198371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.198464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.198565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.198726] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.536948] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.701219] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.862286] env[65119]: INFO networking_nsxv3.common.synchronization [req-753a90d1-8d70-40ff-bcb1-00930d75f4a5 req-9076f8d7-5d79-4be7-8ed8-23a6141a7704 tempest-DeleteServersTestJSON-1411721309 tempest-DeleteServersTestJSON-1411721309-project-member] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1120.863608] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGHEST for action security_group_members [ 1120.863608] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.863608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.863608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.863929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.863929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.864065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.864065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.864185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.864508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.864580] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.214844] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.214844] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1121.214844] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.214844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.214844] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1121.214844] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401587e3-1d61-4cfb-98f7-6ad8e08b67c0: rpc.has_security_group_logging(os_id): False [ 1121.223791] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.223992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.224051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.224270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.224361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.224609] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.224718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.224766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.224915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.224990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.225087] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be created. [ 1121.294707] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.294923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.294971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.295192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.295372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.310242] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1121.367116] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.367345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.367345] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.367583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.367680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.367888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.368321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.368393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.368567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.368647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.368957] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be updated. [ 1121.402022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.402246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.402246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.402532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.402670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.422025] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: IN_PROGRESS for 2s [ 1123.089535] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1123.089816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.322604] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1123.322814] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.432373] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78855541-03b8-4d32-871e-c374cb44f414 in Status: SUCCESS [ 1123.432606] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78855541-03b8-4d32-871e-c374cb44f414 deletion is rescheduled due to dependency. [ 1123.432735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991274] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1125.991643] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1126.254496] env[65119]: INFO networking_nsxv3.common.synchronization [req-8480bf1f-1a11-43d0-9750-41d5994ffd66 req-a5b96dec-5f91-4253-a7de-4b66a6e47769 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1126.254496] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1126.254496] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.254612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.254641] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.254847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.255278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.255278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.255278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.255592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.255592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.255592] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.758441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.260456] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.763295] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.763774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.763872] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.764157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.764257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.764365] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1127.799623] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.799790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.799875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.800241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.801364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.811451] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1127.977673] env[65119]: INFO networking_nsxv3.common.synchronization [req-c7a4702f-fb5f-4c6f-b95f-7c3c5e536c2f req-b258babe-4eca-46e1-9d46-b9921f31c851 tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 1127.978352] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGHEST for action security_group_members [ 1127.978663] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.978781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.978832] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.979142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.979294] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.979378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.979427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.979871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.979871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.979871] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.482558] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.482906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.482906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.483101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.483204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.483417] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.483519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.483580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.483999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.483999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.483999] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be updated. [ 1128.527345] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.527525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.527638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.527874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.528061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.539995] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: IN_PROGRESS for 2s [ 1129.822535] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1129.822850] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.549671] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e282651-46df-44c0-8922-eca67aa74d66 in Status: SUCCESS [ 1130.549844] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 deletion is rescheduled due to dependency. [ 1130.549953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.264320] env[65119]: INFO networking_nsxv3.common.synchronization [None req-4dee4d2d-9f36-4d54-8c3f-91456b05d0cd None None] Enqueued Resource ID: b20520f5-ebaf-4d3a-aac6-5312a22fb76e with Priority: HIGHEST for action port [ 1131.264582] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20520f5-ebaf-4d3a-aac6-5312a22fb76e with Priority: HIGHEST for action port [ 1131.265171] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b20520f5-ebaf-4d3a-aac6-5312a22fb76e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.265269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b20520f5-ebaf-4d3a-aac6-5312a22fb76e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.265328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b20520f5-ebaf-4d3a-aac6-5312a22fb76e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.265573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b20520f5-ebaf-4d3a-aac6-5312a22fb76e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.265650] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20520f5-ebaf-4d3a-aac6-5312a22fb76e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.768977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b20520f5-ebaf-4d3a-aac6-5312a22fb76e [ 1131.768977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.768977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.768977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.768977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.768977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.768977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b20520f5-ebaf-4d3a-aac6-5312a22fb76e already deleted. [ 1131.768977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b20520f5-ebaf-4d3a-aac6-5312a22fb76e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.874454] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ca5cde19-cd21-48c0-96e2-888dc92e0f7b tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1131.874773] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1131.875121] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.875230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.875299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.875545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.875630] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.973887] env[65119]: INFO networking_nsxv3.common.synchronization [None req-43d0f31e-882a-45d5-a893-4d56253ebdb4 tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1131.974475] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1131.974788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.975019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.397491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.397816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.397816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.397970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.398014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.398118] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 already deleted. [ 1132.398200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.398362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.399096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.399096] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.770794] env[65119]: INFO networking_nsxv3.common.synchronization [req-6673672e-28bf-42ad-ad7a-cb7db9e94eb3 req-410be2dc-b74c-40b0-90ca-8a3e0c5c5457 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1132.771501] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1132.771501] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.771655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.771655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.771863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.772636] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.772790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.772858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.773055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.773164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.773262] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.924054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.924321] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.924422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.924732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.924890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.925088] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 already deleted. [ 1132.925300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.157750] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.161019] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.161019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.161019] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.161019] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.161019] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.161019] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.161019] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.161019] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.161019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.181157] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.181409] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.181798] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.181798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.182223] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.182411] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.182531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.182884] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.183034] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bf472f5-64c1-4281-9a53-0fdaad0fbcd3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.275820] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.685200] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.685603] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.685603] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.685858] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.686017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.686182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 not found, creating... [ 1133.686637] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.686814] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.686931] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.687177] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.687393] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.687713] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.687873] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.687990] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.688236] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.688373] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.688511] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 is going to be created. [ 1133.709284] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.709515] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.709744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.710029] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.710270] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.710498] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.744764] env[65119]: INFO networking_nsxv3.common.synchronization [None req-9310c8d0-2c89-413f-b1bd-d2909dde36ee None None] Enqueued Resource ID: e3742029-3c2d-4826-b619-70e558d27536 with Priority: HIGHEST for action port [ 1133.745444] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3742029-3c2d-4826-b619-70e558d27536 with Priority: HIGHEST for action port [ 1133.745444] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3742029-3c2d-4826-b619-70e558d27536 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.745609] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3742029-3c2d-4826-b619-70e558d27536" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.745646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3742029-3c2d-4826-b619-70e558d27536" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.746626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3742029-3c2d-4826-b619-70e558d27536" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.746626] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3742029-3c2d-4826-b619-70e558d27536',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.778462] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.247761] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3742029-3c2d-4826-b619-70e558d27536 [ 1134.248041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.248183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.248252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.248463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.248580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.248691] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3742029-3c2d-4826-b619-70e558d27536 already deleted. [ 1134.248794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3742029-3c2d-4826-b619-70e558d27536" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.282326] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.282550] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.282768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.282996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.283119] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.283346] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be updated. [ 1134.320079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.320079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.320356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.320444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.320617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.331064] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1134.717700] env[65119]: INFO networking_nsxv3.common.synchronization [req-6673672e-28bf-42ad-ad7a-cb7db9e94eb3 req-489ef432-5bd1-40bb-87ec-f9949abe7680 service nova] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1134.718113] env[65119]: INFO networking_nsxv3.common.synchronization [req-6673672e-28bf-42ad-ad7a-cb7db9e94eb3 req-489ef432-5bd1-40bb-87ec-f9949abe7680 service nova] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1134.718113] env[65119]: INFO networking_nsxv3.common.synchronization [req-6673672e-28bf-42ad-ad7a-cb7db9e94eb3 req-489ef432-5bd1-40bb-87ec-f9949abe7680 service nova] Enqueued Resource ID: 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 with Priority: HIGHEST for action port [ 1134.718541] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_rules [ 1134.718708] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1134.718841] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 with Priority: HIGHEST for action port [ 1134.719134] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.723020] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.723020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.723020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.723020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.723020] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bf472f5-64c1-4281-9a53-0fdaad0fbcd3',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.969580] env[65119]: INFO networking_nsxv3.common.synchronization [None req-943dbc50-8028-47c0-ab32-cc024dc830ea tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1134.970147] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1134.970462] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.970586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.970672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.970931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.971054] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.075734] env[65119]: INFO networking_nsxv3.common.synchronization [None req-bc4dfa8e-58dd-499b-b465-04af607db107 tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1135.076304] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1135.076620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.076693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.223555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.223674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.226061] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 with status ACTIVE [ 1135.226306] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.226390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.226451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.226661] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.226753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.226929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.227037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.227097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.227251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.227327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.227500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.227593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.227655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.227808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.227882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.227964] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bf472f5-64c1-4281-9a53-0fdaad0fbcd3 is going to be updated. [ 1135.248771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.248937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.248978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.249188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.249324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.249489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bf472f5-64c1-4281-9a53-0fdaad0fbcd3" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.491486] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.491486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.491713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.491874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.491924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.492099] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 already deleted. [ 1135.492247] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.492413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.492651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.492772] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.014432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.014432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.014432] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.014977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.014977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.014977] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 already deleted. [ 1136.014977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.342275] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1136.342452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.342640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.342894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.343125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.343269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.343339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.343498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.343593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.343699] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.845992] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.347901] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.850647] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.850647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.850647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.850887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.851009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.851173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be updated. [ 1137.884614] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.884614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.884614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.884839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.885048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.893800] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1139.905222] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1139.905577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.905577] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.905813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.906013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.906139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.906207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.906362] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.906442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.906528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.906619] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.077682] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1140.077823] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1140.286359] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab75f70b-42ff-4fa6-971f-27a55cb6bf2c req-bb5d8576-d316-4209-8cdf-dede0862addf tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1140.287171] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1140.287338] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.287510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.287582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.287803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.287965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.288090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.288154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.288559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.288559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.288559] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.411792] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.679223] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.680805] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.680805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.681111] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.681111] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.681183] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.681792] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.681792] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.681792] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.681792] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.681792] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.701638] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.701819] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.701985] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.702416] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.702712] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-c09dbf57-1df8-422b-8541-2f272ebb77b6 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.702939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.703151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.703536] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.703682] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09dbf57-1df8-422b-8541-2f272ebb77b6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.790966] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.916961] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401587e3-1d61-4cfb-98f7-6ad8e08b67c0: rpc.has_security_group_logging(os_id): False [ 1140.934711] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.934964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.934964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.935139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.935226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.935551] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.935727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.935837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.935982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.936090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.936189] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be updated. [ 1140.997616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.997816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.997878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.998082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.998251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.013253] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1141.206668] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.207017] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.207101] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.207413] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.207631] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.207835] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port c09dbf57-1df8-422b-8541-2f272ebb77b6 not found, creating... [ 1141.208147] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.208331] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.208459] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.208726] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.208892] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.209239] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.209445] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.209543] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.209796] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.209926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.210098] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: c09dbf57-1df8-422b-8541-2f272ebb77b6 is going to be created. [ 1141.234564] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.234842] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.234971] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.235251] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.235474] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.235692] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.293786] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.795788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.795956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.796046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.796269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.796361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.796462] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1141.824118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.824290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.824367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.824602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.824752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.834386] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1141.929595] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab75f70b-42ff-4fa6-971f-27a55cb6bf2c req-941520b1-48ea-41ea-abe0-a23a9c68aa6a service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1141.929840] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab75f70b-42ff-4fa6-971f-27a55cb6bf2c req-941520b1-48ea-41ea-abe0-a23a9c68aa6a service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1141.929875] env[65119]: INFO networking_nsxv3.common.synchronization [req-ab75f70b-42ff-4fa6-971f-27a55cb6bf2c req-941520b1-48ea-41ea-abe0-a23a9c68aa6a service nova] Enqueued Resource ID: c09dbf57-1df8-422b-8541-2f272ebb77b6 with Priority: HIGHEST for action port [ 1141.930389] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1141.930523] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1141.930620] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09dbf57-1df8-422b-8541-2f272ebb77b6 with Priority: HIGHEST for action port [ 1141.930887] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.931015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.931235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.931405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.931490] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.933411] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.933517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.933721] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c09dbf57-1df8-422b-8541-2f272ebb77b6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.933827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.933891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.934084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.934163] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09dbf57-1df8-422b-8541-2f272ebb77b6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.434570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.434743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.436167] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c09dbf57-1df8-422b-8541-2f272ebb77b6 with status ACTIVE [ 1142.436382] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.436496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.436567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.436782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.436871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.437062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.437162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.437225] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.437383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.437459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.437637] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.437732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.437827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.438111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.438111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.438111] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c09dbf57-1df8-422b-8541-2f272ebb77b6 is going to be updated. [ 1142.459693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.459867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.459904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.460141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.460285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.460443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c09dbf57-1df8-422b-8541-2f272ebb77b6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.725867] env[65119]: INFO networking_nsxv3.common.synchronization [req-b74ec655-c099-4e08-8ecf-77631e82bcba req-0b949073-8bb0-4a4b-a471-1cbf01afb0b5 tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1142.726491] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1142.726885] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.726885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.726885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.727086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.727274] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.727355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.727420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.727578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.727673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.727803] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.034428] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1143.034761] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.061370] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.061669] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.061900] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.062393] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.062863] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.063129] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.063328] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.063656] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.064293] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.064293] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.064556] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.064556] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.064683] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.064861] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.065037] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.065248] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.086131] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.086355] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.086494] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.086671] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.086984] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.087174] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.087296] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.087616] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.087759] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.230109] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.230290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.230411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.230562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.230651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.230851] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.230952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.231017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.231169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.231244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.231327] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 already deleted. [ 1143.231407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.592581] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.592581] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.593141] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.593205] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.593545] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.593693] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf not found, creating... [ 1143.594131] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.594750] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.594750] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.594927] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.595192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.595671] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.595895] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.596086] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.596465] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.596805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.596927] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf is going to be created. [ 1143.620018] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.620355] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.620405] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.620662] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.620913] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.621151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.844696] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1143.844977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.844977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.845230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.845406] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.845524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.845591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.845912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.845912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.845912] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.342761] env[65119]: INFO networking_nsxv3.common.synchronization [req-b74ec655-c099-4e08-8ecf-77631e82bcba req-5ef529aa-25d0-4323-aabf-c8f91a4b727a service nova] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1144.343083] env[65119]: INFO networking_nsxv3.common.synchronization [req-b74ec655-c099-4e08-8ecf-77631e82bcba req-5ef529aa-25d0-4323-aabf-c8f91a4b727a service nova] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1144.343083] env[65119]: INFO networking_nsxv3.common.synchronization [req-b74ec655-c099-4e08-8ecf-77631e82bcba req-5ef529aa-25d0-4323-aabf-c8f91a4b727a service nova] Enqueued Resource ID: 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf with Priority: HIGHEST for action port [ 1144.343521] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_rules [ 1144.343665] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1144.343763] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf with Priority: HIGHEST for action port [ 1144.344135] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.344215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.344282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.344477] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.344606] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.345501] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.345612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.345674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.346030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.346030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.346116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.346148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.346281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.346367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.346456] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.347876] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.347876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.347876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.347876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.347876] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.349078] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.446231] env[65119]: INFO networking_nsxv3.common.synchronization [None req-e0f5c024-d07f-480a-9821-eb652a933e9f tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1144.446231] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1144.446965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.446965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.447157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.447192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.447911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.447911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.447911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.447911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.447911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.447911] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.849777] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.849991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.850159] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.851091] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf with status ACTIVE [ 1144.851280] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.851393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.851459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.851748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.851843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.852033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.852135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.852187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.852351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.856022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.856022] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.856022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.856022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.856022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.856022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.856022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf is going to be updated. [ 1144.856022] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.878218] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.878380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.878472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.878713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.878856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.879063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a38bf16-e45c-427d-8a55-a8cbdd5ff1bf" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.950161] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.950465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.950465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.950635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.950713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.950884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.950982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.951048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.951197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.951275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.951362] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1145.102477] env[65119]: INFO networking_nsxv3.common.synchronization [req-90bf9331-6267-4ee6-bb8c-07fb00ca7237 req-788acfc8-a653-4a34-a634-f97ac2ef395d tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1145.103208] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1145.103438] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.103558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.103618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.103874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.104097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.104227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.104299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.104464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.104552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.104647] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.139693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.139915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.139995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.140232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.140387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.199262] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1145.357193] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.359090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.359090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.359090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.359090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.359090] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.359090] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1145.388939] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.388939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.388939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.388939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.388939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.399333] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1145.518571] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-283 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.518926] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.519148] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.519534] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.519914] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.522046] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.522046] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.522046] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.522046] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.522046] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.522046] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.522046] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.522046] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.522046] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.522046] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.522046] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.541140] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.541316] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.541462] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.541642] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.542046] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-7a693f53-6264-4417-a004-8f527774f0c1 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.542232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.542352] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.542664] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.542808] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a693f53-6264-4417-a004-8f527774f0c1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.607270] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.607270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.607270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.607270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.607270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.607506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.607506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.607506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.607612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.607642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.607738] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 already deleted. [ 1145.607805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.861247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.861451] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.861496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.861681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.861847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.861949] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 is going to be created. [ 1145.884124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.884266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.884338] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.884540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.884697] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.893797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: UNINITIALIZED for 2s [ 1146.046641] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.047583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.047583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.047583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.047583] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.047791] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 7a693f53-6264-4417-a004-8f527774f0c1 not found, creating... [ 1146.048272] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.048272] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.048411] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.048797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.048797] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.049112] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.049303] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.049486] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.049729] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.049945] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.050105] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 7a693f53-6264-4417-a004-8f527774f0c1 is going to be created. [ 1146.074836] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.075131] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.075254] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.075548] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.075798] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.076058] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.772163] env[65119]: INFO networking_nsxv3.common.synchronization [req-90bf9331-6267-4ee6-bb8c-07fb00ca7237 req-421e50dc-4139-469f-aa57-3722c2befa6f service nova] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1146.772410] env[65119]: INFO networking_nsxv3.common.synchronization [req-90bf9331-6267-4ee6-bb8c-07fb00ca7237 req-421e50dc-4139-469f-aa57-3722c2befa6f service nova] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1146.772475] env[65119]: INFO networking_nsxv3.common.synchronization [req-90bf9331-6267-4ee6-bb8c-07fb00ca7237 req-421e50dc-4139-469f-aa57-3722c2befa6f service nova] Enqueued Resource ID: 7a693f53-6264-4417-a004-8f527774f0c1 with Priority: HIGHEST for action port [ 1146.772982] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1146.773873] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1146.774041] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a693f53-6264-4417-a004-8f527774f0c1 with Priority: HIGHEST for action port [ 1146.774345] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.774488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.774533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.775702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.775702] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.775960] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.776194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.776194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.776406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.776478] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.776854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.776854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.776854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.776854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.776995] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.777824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a693f53-6264-4417-a004-8f527774f0c1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.777929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.778039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.778165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.778249] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a693f53-6264-4417-a004-8f527774f0c1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.211857] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1147.211857] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f deletion is rescheduled due to dependency. [ 1147.211857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.280408] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.280643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.280754] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.281845] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a693f53-6264-4417-a004-8f527774f0c1 with status ACTIVE [ 1147.282267] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.282267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.282267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.282444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.282475] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.282622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.282716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.282808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.283069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.283153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.283337] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.283425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.283533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.283777] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.283861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.284080] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a693f53-6264-4417-a004-8f527774f0c1 is going to be updated. [ 1147.307108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.307256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.307326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.307533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.307666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.307823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.408797] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1147.409105] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.409277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.409489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.409683] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.409810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.409884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.410051] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.410137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.410223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.410316] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.786994] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.903827] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: SUCCESS [ 1147.904488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.904488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.904488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.904635] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.904733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.904780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.904908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.905224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.905224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.905224] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.913025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.913331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.914755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.914998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.915190] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.915300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.915366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.915517] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.915600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.915687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.916539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.916539] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.916539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.916843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.916843] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.916843] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.290220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.290220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.290220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.290220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.290220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.290526] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be created. [ 1148.316879] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.317128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.317210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.317480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.317729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.331135] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: UNINITIALIZED for 2s [ 1148.408208] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.419060] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1148.442149] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.442328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.442403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.442588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.442968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.443123] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.443237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.443315] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.443390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.443592] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.443750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.443750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.443880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.443939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.444195] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.444317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.444390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.444492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.444564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.444651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1148.566400] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.566728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.566861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.567142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.567557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.593288] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1148.910708] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 943bb395-8b85-4c59-b9e0-3f26c98e1568: rpc.has_security_group_logging(os_id): False [ 1148.930055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.930301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.930301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.930633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.930749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.931129] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.931246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.931302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.931512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.931596] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.931690] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 is going to be created. [ 1149.009747] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.009921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.010013] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.010275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.010468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.024975] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: IN_PROGRESS for 2s [ 1150.344120] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1150.344120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.344120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.344120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.344574] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.344574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.344574] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.344687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.344687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.344862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.344862] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.608513] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1150.608794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.849706] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.039022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: SUCCESS [ 1151.039312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.351316] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84645f68-06be-4009-8d3b-bc8402e7e9e4: rpc.has_security_group_logging(os_id): False [ 1151.370016] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.370187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.370271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.370452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.370539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.370780] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.370879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.370945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.371107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.371189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.371268] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be created. [ 1151.435848] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.435848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.435848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.435848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.435848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.447230] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: IN_PROGRESS for 2s [ 1151.775275] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1151.775419] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1153.461774] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1153.462117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.358739] env[65119]: INFO networking_nsxv3.common.synchronization [req-b0b7301e-46ee-44b0-be3c-3bfd6e38e81b req-31e9f9ce-3dd1-4cc6-b78f-e64f95459937 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1155.359464] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1155.359847] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.360032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.362017] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.362017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.362017] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.863975] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.196977] env[65119]: INFO networking_nsxv3.common.synchronization [req-bafe1982-e72c-42fa-9400-d200c8705398 req-935ee2bf-d89c-4a33-acb0-3770f121cb06 tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 1156.197547] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGHEST for action security_group_members [ 1156.197852] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.197972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.198080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.198291] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.198450] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.198552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.198615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.198771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.198852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.198947] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.365949] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.702064] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.702064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.702064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.702064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.702421] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.702421] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.702510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.702545] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.702686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.702756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.702842] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 is going to be updated. [ 1156.740508] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.740733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.740733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.740936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.741117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.752564] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: IN_PROGRESS for 2s [ 1156.869457] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.869626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.869626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.869817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.869927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.870156] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1156.913831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.913831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.913831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.914133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.914133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.925471] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1158.311281] env[65119]: INFO networking_nsxv3.common.synchronization [req-0299ddd8-ef56-4bed-9a09-6a32ec88a2e8 req-84201a37-a791-488c-b069-39681992ddea tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1158.311974] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGHEST for action security_group_members [ 1158.312362] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.312512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.312556] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.312931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.313220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.313382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.313459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.313706] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.314092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.314092] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.762326] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 in Status: SUCCESS [ 1158.762512] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 deletion is rescheduled due to dependency. [ 1158.762626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.816818] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.817014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.817357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.817357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.817523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.817581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.817890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.817890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.818068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.818140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.818194] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d is going to be updated. [ 1158.846609] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.847235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.847503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.847845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.849019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.858371] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: IN_PROGRESS for 2s [ 1158.935137] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1158.935386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.869081] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13a91696-7519-44b6-b10f-fc41ed3e295d in Status: SUCCESS [ 1160.869464] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d deletion is rescheduled due to dependency. [ 1160.869464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.091856] env[65119]: INFO networking_nsxv3.common.synchronization [None req-86c3acce-2ffc-44a9-8826-5da1b0096b5c tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1163.092536] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1163.093042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.093252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.093344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.093586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.093673] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.225622] env[65119]: INFO networking_nsxv3.common.synchronization [None req-1b1ec8b9-a93b-4cda-a30b-aa2e01e9eeb6 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1163.226239] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1163.226930] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.228587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.615412] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.615603] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.615693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.615894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.616025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.616131] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab already deleted. [ 1163.616220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.616400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.616564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.616650] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.136362] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.136687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.136687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.136795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.136886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.136983] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab already deleted. [ 1164.137104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.177769] env[65119]: INFO networking_nsxv3.common.synchronization [req-3803af44-8980-4cd3-b010-786400eb72e1 req-26e12a56-c568-491b-b172-2449ff017d35 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1165.178152] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1165.178667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.178775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.178848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.179057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.179212] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.179306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.179414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.179667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.179667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.179761] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.493231] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.493231] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.493416] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.493653] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.493971] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.494192] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.494354] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.494683] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.494855] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.495178] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.495393] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.495585] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.495754] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.495964] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.496178] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.496429] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.518147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.518370] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.518560] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.518781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-333" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.519147] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.519376] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.519526] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.519916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.520125] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ef41dc-2f95-47cb-81d2-16fa2b4d29a0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.682478] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.022880] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.023201] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.023201] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.023478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.023636] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.023790] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 not found, creating... [ 1166.024067] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.024229] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.024346] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.024571] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.024709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.024986] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.025158] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.025272] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.025476] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.025603] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.025739] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 is going to be created. [ 1166.047652] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.047865] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.047981] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.048292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.048525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.048753] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.185156] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.688086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.688086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.688086] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.688433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.688433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.688495] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1166.719610] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.719741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.719840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.720068] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.720292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.730355] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1166.735776] env[65119]: INFO networking_nsxv3.common.synchronization [req-3803af44-8980-4cd3-b010-786400eb72e1 req-ca0d6f03-7d5e-4137-93e2-5c306631bc83 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1166.735964] env[65119]: INFO networking_nsxv3.common.synchronization [req-3803af44-8980-4cd3-b010-786400eb72e1 req-ca0d6f03-7d5e-4137-93e2-5c306631bc83 service nova] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1166.736025] env[65119]: INFO networking_nsxv3.common.synchronization [req-3803af44-8980-4cd3-b010-786400eb72e1 req-ca0d6f03-7d5e-4137-93e2-5c306631bc83 service nova] Enqueued Resource ID: 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 with Priority: HIGHEST for action port [ 1166.736643] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_rules [ 1166.736754] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1166.736880] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 with Priority: HIGHEST for action port [ 1166.737486] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.737626] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.737718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.737931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.738036] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.739889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.740061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.740344] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.740459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.740459] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.740622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.740704] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ef41dc-2f95-47cb-81d2-16fa2b4d29a0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.240591] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.240931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.243189] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 with status ACTIVE [ 1167.243374] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.243528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.243528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.243709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.243791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.243965] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.244128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.244216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.244387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.244470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.244694] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.244797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.244863] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.245037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.245134] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.245236] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39ef41dc-2f95-47cb-81d2-16fa2b4d29a0 is going to be updated. [ 1167.265766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.265917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.265990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.266206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.266349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.266506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ef41dc-2f95-47cb-81d2-16fa2b4d29a0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.488632] env[65119]: INFO networking_nsxv3.common.synchronization [req-63b9b2a1-364a-4025-8f81-12eb0a2643dd req-4f842df6-e543-4ede-8798-33737576c73d tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 1167.488632] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 1167.488902] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.488995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.490360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.490535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.490712] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.490819] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.490883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.491058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.491162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.491283] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.995732] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.497528] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.741506] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1168.741506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.741506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.741986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.741986] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.742193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.742266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.742473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.742566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.742678] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.794015] env[65119]: INFO networking_nsxv3.common.synchronization [req-ac7efae9-268a-4cf1-bdaf-901239cec104 req-a99550aa-97ba-4164-8d8c-fc6aeaf15345 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1168.794353] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1168.794698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.794824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.794890] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.795208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.795432] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.795629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.795678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.795816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.795951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.796086] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.001025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.001257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.001257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.001464] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.001549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.001646] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 1169.034856] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.035113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.035113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.035651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.035651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.047548] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 1169.245374] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.299442] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.299619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.299662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.299878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.299967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.300258] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.300390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.300390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.300522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.300598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.300681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab already deleted. [ 1169.300760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.592904] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.593273] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.593334] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.593728] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.593822] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.593976] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.597091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.598255] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.598754] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.598754] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.599369] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.599549] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.599696] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.599841] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.600010] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.600393] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.622720] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.622891] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.623108] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.623249] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-224" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.624028] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-fd57168d-926b-448f-9c71-7d73505c6392 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.624028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.624028] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.624217] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.624355] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd57168d-926b-448f-9c71-7d73505c6392',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.747205] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.130236] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.130473] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.130620] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.130904] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.131072] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.131233] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port fd57168d-926b-448f-9c71-7d73505c6392 not found, creating... [ 1170.131503] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.131660] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.131777] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.131993] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.132178] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.132452] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.132606] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.132722] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.132933] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.133079] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.133230] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: fd57168d-926b-448f-9c71-7d73505c6392 is going to be created. [ 1170.156690] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.156916] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.157039] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.157314] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.157624] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.157774] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.249801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.250191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.250191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.250355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.250408] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.250516] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1170.292990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.293216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.293216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.293391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.293621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.304620] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1170.933204] env[65119]: INFO networking_nsxv3.common.synchronization [req-ac7efae9-268a-4cf1-bdaf-901239cec104 req-03b547c8-6378-43ed-a558-adb63c3fd250 service nova] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1170.933445] env[65119]: INFO networking_nsxv3.common.synchronization [req-ac7efae9-268a-4cf1-bdaf-901239cec104 req-03b547c8-6378-43ed-a558-adb63c3fd250 service nova] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1170.933499] env[65119]: INFO networking_nsxv3.common.synchronization [req-ac7efae9-268a-4cf1-bdaf-901239cec104 req-03b547c8-6378-43ed-a558-adb63c3fd250 service nova] Enqueued Resource ID: fd57168d-926b-448f-9c71-7d73505c6392 with Priority: HIGHEST for action port [ 1170.934309] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_rules [ 1170.934507] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1170.934824] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd57168d-926b-448f-9c71-7d73505c6392 with Priority: HIGHEST for action port [ 1170.935044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.935670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.935824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.935954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.936081] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.937522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.937659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.937716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.938192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.938402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.938509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.938582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.938749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.938827] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.939108] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.940490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd57168d-926b-448f-9c71-7d73505c6392 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.940640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.940640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.940898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.940997] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd57168d-926b-448f-9c71-7d73505c6392',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.062998] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 1171.063280] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.442935] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.444130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.444271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.445839] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd57168d-926b-448f-9c71-7d73505c6392 with status ACTIVE [ 1171.446130] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.446306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.446417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.446695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.446823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.447026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.447184] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.447293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.447549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.447682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.447978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.448166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.448282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.448527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.448664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.448788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd57168d-926b-448f-9c71-7d73505c6392 is going to be updated. [ 1171.473115] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.473333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.473412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.473637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.473785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.473950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd57168d-926b-448f-9c71-7d73505c6392" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.945371] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.315762] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1172.315983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.316243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.316518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.316737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.316893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.317045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.317133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.317218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.317391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.317513] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.448653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.448889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.448971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.449257] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.449357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.449464] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab is going to be created. [ 1172.475812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.476056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.476159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.476481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.476745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.490723] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: UNINITIALIZED for 2s [ 1172.820693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.820896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.820896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.821039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.822183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.822183] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.822621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.822621] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.822621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.822621] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.822826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.822871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.822987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.823079] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.327019] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb75ad9c-4e20-475c-9f48-9dc0b70cd915: rpc.has_security_group_logging(os_id): False [ 1173.347530] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.347818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.348083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.348463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.348838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.349074] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.349259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.349411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.349696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.349846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.350182] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.350342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.350481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.350745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.350917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.351262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.351424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.351554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.351797] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.351961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.352149] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1173.439754] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.439990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.439990] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440281] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.440423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.467181] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1174.322744] env[65119]: INFO networking_nsxv3.common.synchronization [req-9fe09c6d-323b-475c-8194-f3b251a846b3 req-72ef71d3-9bcb-4d5e-a912-eeade5e5f986 tempest-ServerRescueNegativeTestJSON-190593462 tempest-ServerRescueNegativeTestJSON-190593462-project-member] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 1174.323293] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGHEST for action security_group_members [ 1174.323627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.323752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.323821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.324028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.324184] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.324277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.324387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.324674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.324674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.324833] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.503571] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: SUCCESS [ 1174.503919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.505214] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.505214] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.505214] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.827042] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.827179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.827235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.827424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.827521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.827731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.827840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.827919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.828076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.828153] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.828247] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be updated. [ 1174.856853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.857104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.857104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.857301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.857454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.866055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: IN_PROGRESS for 2s [ 1175.007919] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.485675] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1175.485959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.510527] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35f68711-15e4-49bb-8405-30e4227c46ab: rpc.has_security_group_logging(os_id): False [ 1175.529467] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.529710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.529710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.530467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.530467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.530990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.531260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.531260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.531455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.531568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.531684] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab is going to be created. [ 1175.574500] env[65119]: INFO networking_nsxv3.common.synchronization [req-989b26f1-3109-4925-9a9f-bc3b3e932625 req-c354e6f1-00c7-419b-96dc-fb91a1dfb418 tempest-ServerActionsV293TestJSON-1222267651 tempest-ServerActionsV293TestJSON-1222267651-project-member] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1175.575695] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGHEST for action security_group_members [ 1175.576034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.576182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.576267] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.576420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.576577] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.576680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.579494] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.579794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.579919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.580156] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.621323] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.621508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.621578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.621785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.622191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.646589] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: IN_PROGRESS for 2s [ 1176.085052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.085052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.085052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.085052] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 is going to be updated. [ 1176.115619] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.115803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.115847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.116076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.116299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.126428] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: IN_PROGRESS for 2s [ 1176.879562] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f in Status: SUCCESS [ 1176.879838] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f deletion is rescheduled due to dependency. [ 1176.879881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.662639] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: SUCCESS [ 1177.662917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.136996] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 in Status: SUCCESS [ 1178.137383] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 deletion is rescheduled due to dependency. [ 1178.137424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.577130] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1180.577452] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1181.189914] env[65119]: INFO networking_nsxv3.common.synchronization [req-81a9b065-7306-487a-b768-57c8b49ddc19 req-85f9bed2-ea48-42c0-8fe8-31f003ec140f tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1181.190770] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1181.191083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.191235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.191306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.191533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.191713] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.191823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.191889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.192072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.192193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.192359] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.325373] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.325604] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.325739] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.326090] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.326404] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.326590] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.326878] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.326983] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.327181] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.327444] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.327643] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.327782] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.328018] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.328063] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.328181] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.328334] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.351730] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.351954] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.352110] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.352365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.352677] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-91cda656-a7da-4530-aed5-95e0b1c7cd21 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.352851] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.352969] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.353330] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.353483] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cda656-a7da-4530-aed5-95e0b1c7cd21',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.695677] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.856176] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.856328] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.856477] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.856738] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.856889] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.857057] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 91cda656-a7da-4530-aed5-95e0b1c7cd21 not found, creating... [ 1181.857318] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.857478] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.857590] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.857801] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.857935] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.858231] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.858388] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.858505] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.858707] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.858842] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.858978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 is going to be created. [ 1181.880464] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.880699] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.880836] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.881103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.881343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.881572] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.197582] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.661284] env[65119]: INFO networking_nsxv3.common.synchronization [req-966e11a6-b654-4c0b-965d-bc7a655980fc req-4dcbdb35-4b02-4e21-8d51-5648c8d12529 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1182.661598] env[65119]: INFO networking_nsxv3.common.synchronization [req-966e11a6-b654-4c0b-965d-bc7a655980fc req-4dcbdb35-4b02-4e21-8d51-5648c8d12529 service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1182.661767] env[65119]: INFO networking_nsxv3.common.synchronization [req-966e11a6-b654-4c0b-965d-bc7a655980fc req-4dcbdb35-4b02-4e21-8d51-5648c8d12529 service nova] Enqueued Resource ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 with Priority: HIGHEST for action port [ 1182.662712] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1182.662906] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1182.662974] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 with Priority: HIGHEST for action port [ 1182.663404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.663535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.663591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.663798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.663878] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.664788] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.665095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.665095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.665243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.666575] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.666575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.666575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.666575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.666575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.666575] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.667520] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-91cda656-a7da-4530-aed5-95e0b1c7cd21 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.667660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.668009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.668009] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.668009] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cda656-a7da-4530-aed5-95e0b1c7cd21',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.699522] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.699833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.699833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.699991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.700069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.700215] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1182.731322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.731455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.731455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.731631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.731777] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.742148] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1183.168021] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.169480] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.169480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.169480] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91cda656-a7da-4530-aed5-95e0b1c7cd21 with status ACTIVE [ 1183.169662] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.169662] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.169828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.169942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.170020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.170214] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.170316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.170375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.170540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.170618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.170801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.170892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.170973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.171218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.171292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.171378] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 is going to be updated. [ 1183.197025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.197287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.197287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.197449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.197583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.197742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.674188] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.176747] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.177292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.177292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.177292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.177476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.177476] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1184.214055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.214260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.214364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.214668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.214864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.225369] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1184.752435] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1184.752748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.236046] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1186.236359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.236359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.236519] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.236711] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.236829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.236898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.237050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.237127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.237197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.237296] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.739755] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.739998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.739998] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.740241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.740420] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.740531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.740600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.740765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.740870] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.740960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.741129] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.741227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.741290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.741458] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.741630] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.741745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.741808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.741951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.742042] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.742129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.742222] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.244522] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2994e442-555a-4a06-b1c7-b7bebbd61b5f: rpc.has_security_group_logging(os_id): False [ 1187.264286] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.264489] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.264563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.264796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.264892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.265148] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.265263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.265399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.265589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.265698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.265929] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.266108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.266193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.266380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.266509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.266789] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.266910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.266986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.267187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.267282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.267399] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1187.355463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.355463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.355583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.355701] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.355859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.370559] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1187.663522] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1187.663711] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1188.931590] env[65119]: INFO networking_nsxv3.common.synchronization [req-858d329c-a3ce-4197-bb01-5c76265dbb0a req-52e316a3-7416-4397-80e2-f6e47dbaf097 tempest-ServersTestJSON-1030211566 tempest-ServersTestJSON-1030211566-project-member] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1188.932060] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGHEST for action security_group_members [ 1188.932500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.932598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.932598] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.932787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.933063] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.933063] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.933158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.933324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.933384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.933455] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.387122] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1189.387371] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.435290] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.435486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.435539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.435740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.435823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.436028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.436128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.436191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.436337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.436411] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.436496] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be updated. [ 1189.464937] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.465103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.465158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.465359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.465534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.475018] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: IN_PROGRESS for 2s [ 1191.485806] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 in Status: SUCCESS [ 1191.485806] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 deletion is rescheduled due to dependency. [ 1191.485806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.932803] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.933042] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.934390] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.934712] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.957301] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.957489] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.957619] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.957886] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.958146] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.958300] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.958417] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.958722] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.958905] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.959129] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.959243] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.959351] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.959458] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.959567] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.959672] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.959800] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.984337] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.984581] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.984802] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.985015] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-177" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.985343] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-91cda656-a7da-4530-aed5-95e0b1c7cd21 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.985538] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.985693] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.986019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.986188] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cda656-a7da-4530-aed5-95e0b1c7cd21',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.488939] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.489174] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.489302] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.489629] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.489746] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.490037] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.490201] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.490402] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.490630] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.490769] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.491070] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.491229] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.491345] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.491555] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.491686] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.491828] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 is going to be updated. [ 1199.515228] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.515516] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.515652] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.515928] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.516143] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.516369] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b0a9f3b-91b5-423f-8f41-52da4d096ea6 req-e1849123-da59-4d34-afde-d46f6dd9af5e service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b0a9f3b-91b5-423f-8f41-52da4d096ea6 req-e1849123-da59-4d34-afde-d46f6dd9af5e service nova] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [req-9b0a9f3b-91b5-423f-8f41-52da4d096ea6 req-e1849123-da59-4d34-afde-d46f6dd9af5e service nova] Enqueued Resource ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 with Priority: HIGHEST for action port [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_rules [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1200.198941] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 with Priority: HIGHEST for action port [ 1200.199638] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.200242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.200324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.200915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.201028] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.202436] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.202580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.202676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.202867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.203033] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.203157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.203192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.203331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.203418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.203510] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.204889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-91cda656-a7da-4530-aed5-95e0b1c7cd21 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.205070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.205131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.207252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.207252] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cda656-a7da-4530-aed5-95e0b1c7cd21',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.608976] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.609203] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.609328] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.609635] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.609956] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.610138] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.610257] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.610479] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.610633] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.610844] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.611023] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.611152] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.611274] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.611392] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.611502] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.611636] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.629782] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.629944] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1200.630106] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.630287] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-738" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.630828] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b152ad6e-67b9-4f6c-8f44-2d943b044769 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.631108] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.631328] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.631786] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.631963] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b152ad6e-67b9-4f6c-8f44-2d943b044769',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.707582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.708132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.708132] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.708990] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91cda656-a7da-4530-aed5-95e0b1c7cd21 with status ACTIVE [ 1200.708990] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.709122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.709122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.709332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.709419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.709595] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.709689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.709753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.709910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.709989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.710181] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.710275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.710515] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.710668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.710744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.710831] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91cda656-a7da-4530-aed5-95e0b1c7cd21 is going to be updated. [ 1200.733158] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.733346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.733395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.733570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.733709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.733877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91cda656-a7da-4530-aed5-95e0b1c7cd21" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.134047] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.134326] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.134414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.134676] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.134859] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.135157] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.135337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.135514] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.135745] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.135881] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.136191] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.136351] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.136467] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.136673] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.136805] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.136945] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 is going to be updated. [ 1201.158835] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.159103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.159234] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.159504] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.159698] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.159918] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.212885] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.715827] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.716128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.716128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.716283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.716359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.716461] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1201.744524] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.744710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.744763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.744954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.745112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.755349] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1201.838550] env[65119]: INFO networking_nsxv3.common.synchronization [req-89031631-f996-4e49-8eb4-d9704f9666c7 req-326b3323-8d5d-42d1-abeb-253bd5cf6069 service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 1201.838729] env[65119]: INFO networking_nsxv3.common.synchronization [req-89031631-f996-4e49-8eb4-d9704f9666c7 req-326b3323-8d5d-42d1-abeb-253bd5cf6069 service nova] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1201.838865] env[65119]: INFO networking_nsxv3.common.synchronization [req-89031631-f996-4e49-8eb4-d9704f9666c7 req-326b3323-8d5d-42d1-abeb-253bd5cf6069 service nova] Enqueued Resource ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 with Priority: HIGHEST for action port [ 1201.839104] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_rules [ 1201.839233] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1201.839331] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 with Priority: HIGHEST for action port [ 1201.839901] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.839975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.840143] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.840379] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.840481] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.841620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.841745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.842319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.842319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.842319] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.842319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.842319] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.842619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.842619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.842619] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.843282] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b152ad6e-67b9-4f6c-8f44-2d943b044769 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.843415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.843500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.843653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.843941] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b152ad6e-67b9-4f6c-8f44-2d943b044769',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.346072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.346072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.346072] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.346912] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b152ad6e-67b9-4f6c-8f44-2d943b044769 with status ACTIVE [ 1202.347099] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.347226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.347288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.347534] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.347705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.347795] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.347902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.347959] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.348163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.348244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.348420] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.348518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.349158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.349460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.349576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.349683] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b152ad6e-67b9-4f6c-8f44-2d943b044769 is going to be updated. [ 1202.376381] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.376381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.376381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.376381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.376381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.376381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b152ad6e-67b9-4f6c-8f44-2d943b044769" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.852359] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.354532] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.354961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.354961] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.355050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.355098] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.356055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1203.395252] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.395252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.395252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.395528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.396508] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.415063] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1203.769804] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1203.770045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.770222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.770463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.770680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.770804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.770871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.771041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.771125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.771212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.771317] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.273312] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.273570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.273648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.273875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.274388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.274529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.274627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.274759] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.274896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.275016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.275186] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.275282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.275346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.275495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.275638] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.275730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.275793] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.275929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.276014] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.276114] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.276190] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.778763] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2994e442-555a-4a06-b1c7-b7bebbd61b5f: rpc.has_security_group_logging(os_id): False [ 1204.800524] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.800698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.800743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.800937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.801036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.801254] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.801355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.801419] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.801573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.801650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.801831] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.801924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.801985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.802138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.802211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.802392] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.802544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.802610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.802769] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.802853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.802938] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1204.963476] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.963798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.963798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.963979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.964031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.979715] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1205.426053] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1205.426053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.426053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.426053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.426053] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.426389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.426389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.426389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.426389] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.426528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.426528] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.928515] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.431940] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cec5d72a-5222-4ea2-bb61-5a248eace68e: rpc.has_security_group_logging(os_id): False [ 1206.449958] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.450129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.450204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.450416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.450510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.450765] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.450981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.450981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.451431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.451431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.451431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1206.509856] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.510113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.510221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.510591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.510795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.523861] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1206.840319] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.840534] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1207.001058] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1207.001531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.551756] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1208.551756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.841699] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.842274] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1216.000378] env[65119]: INFO networking_nsxv3.common.synchronization [req-80be72e0-348a-4fec-9130-9b513163a62b req-ed9501d0-47ba-4438-ac9b-ad8c2595eacf tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1216.001213] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1216.001605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.001785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.001915] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.002202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.002396] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.002573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.002686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.002938] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.003046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.003143] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.505353] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.008150] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.511698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.511927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.512128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.512216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.512325] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be updated. [ 1217.547786] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.548012] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.548131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.548370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.548548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.559646] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1219.571678] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1219.571971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.921619] env[65119]: INFO networking_nsxv3.common.synchronization [req-0c240449-e7e5-4dbf-be3f-2723af34b125 req-0fcaa6a8-c577-4a31-8910-1397c2c50f49 tempest-ServerActionsTestOtherB-612504563 tempest-ServerActionsTestOtherB-612504563-project-member] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1219.922322] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGHEST for action security_group_members [ 1219.922665] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.922784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.922855] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.923293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.923563] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.923622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.923660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.923830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.923968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.924025] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.427057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.427057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.427057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.427310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.427310] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.427490] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.427941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.427941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.427941] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.428117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.428117] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be updated. [ 1220.456123] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.456349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.456396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.456636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.456781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.466922] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: IN_PROGRESS for 2s [ 1221.440844] env[65119]: INFO networking_nsxv3.common.synchronization [req-ba5bf867-69be-4f29-8238-120b86ff68c4 req-39409263-e448-4b60-afae-18d29b3be769 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1221.441412] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGHEST for action security_group_members [ 1221.441826] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.441934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.441934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.442303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.442477] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.442655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.442734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.442928] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.443030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.443182] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.949030] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.949209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.949284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.949532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.949615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.950825] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.950825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.950825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.950825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.950825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.950825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ab408e-051b-41f8-8797-d5537be1217f is going to be updated. [ 1221.994610] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.994796] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.994847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.995064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.995220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.005413] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: IN_PROGRESS for 2s [ 1222.395483] env[65119]: INFO networking_nsxv3.common.synchronization [req-87d620e6-2c36-4c43-bbdd-792173f7c7b6 req-167c18c6-1680-47bf-a5c4-46e441301c90 tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1222.396449] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGHEST for action security_group_members [ 1222.396449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.396449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.396828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.396828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.396908] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.396981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.397034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.397200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.397254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.397332] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.476900] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cec5d72a-5222-4ea2-bb61-5a248eace68e in Status: SUCCESS [ 1222.476900] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e deletion is rescheduled due to dependency. [ 1222.476900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.900083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.900278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.900333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.900644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.900878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.901618] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.901618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.901618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.901618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.901618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.902130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be updated. [ 1222.932020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.932020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.932020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.932020] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.932332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.944054] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: IN_PROGRESS for 2s [ 1223.134979] env[65119]: INFO networking_nsxv3.common.synchronization [req-59e914a6-479e-4af7-8e53-c2a25d8974c8 req-deb460c8-1659-4377-b274-7ebe3dd5b0cb tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1223.135523] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGHEST for action security_group_members [ 1223.135829] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.135973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.136055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.136275] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.136431] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.136549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.136605] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.136743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.136824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.136915] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.639728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.641874] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.641874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.641874] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 is going to be updated. [ 1223.690977] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.691266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.691266] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.691488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.691576] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.701962] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: IN_PROGRESS for 2s [ 1224.017835] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ab408e-051b-41f8-8797-d5537be1217f in Status: SUCCESS [ 1224.018113] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ab408e-051b-41f8-8797-d5537be1217f deletion is rescheduled due to dependency. [ 1224.018242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.952569] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 in Status: SUCCESS [ 1224.952895] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 deletion is rescheduled due to dependency. [ 1224.952895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.712466] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 in Status: SUCCESS [ 1225.712673] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 deletion is rescheduled due to dependency. [ 1225.712821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.922588] env[65119]: INFO networking_nsxv3.common.synchronization [None req-64c95ebb-e6d4-4bb9-adb5-c0c4ef85322a tempest-AttachInterfacesTestJSON-569791 tempest-AttachInterfacesTestJSON-569791-project-member] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1227.923214] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGHEST for action security_group_members [ 1227.923521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.923644] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.924356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.924356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.924356] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.924356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.924356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.924627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.924627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.924627] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.427299] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.427505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.427568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.427823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.427942] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.428169] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.428278] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.428335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.428502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.428579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.428665] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be updated. [ 1228.460598] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.461488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.461488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.461488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.461488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.471715] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: IN_PROGRESS for 2s [ 1230.484060] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f in Status: SUCCESS [ 1230.484310] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f deletion is rescheduled due to dependency. [ 1230.484358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.391611] env[65119]: INFO networking_nsxv3.common.synchronization [None req-c854fe73-5c4e-4ded-b014-6de81aebdbc7 None None] Enqueued Resource ID: e025f6ff-d5c9-4f96-a784-70bf832323cc with Priority: HIGHEST for action port [ 1232.391611] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e025f6ff-d5c9-4f96-a784-70bf832323cc with Priority: HIGHEST for action port [ 1232.392128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-e025f6ff-d5c9-4f96-a784-70bf832323cc taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.392128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e025f6ff-d5c9-4f96-a784-70bf832323cc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.392328] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e025f6ff-d5c9-4f96-a784-70bf832323cc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.392655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e025f6ff-d5c9-4f96-a784-70bf832323cc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.393502] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e025f6ff-d5c9-4f96-a784-70bf832323cc',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.445742] env[65119]: INFO networking_nsxv3.common.synchronization [None req-ac0701bc-bf3f-4e66-96f4-a05301017895 None None] Enqueued Resource ID: 6323e6a6-ed95-407e-85ea-b6c3a14b49c5 with Priority: HIGHEST for action port [ 1232.446554] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6323e6a6-ed95-407e-85ea-b6c3a14b49c5 with Priority: HIGHEST for action port [ 1232.446554] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-6323e6a6-ed95-407e-85ea-b6c3a14b49c5 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.446707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6323e6a6-ed95-407e-85ea-b6c3a14b49c5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.446750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6323e6a6-ed95-407e-85ea-b6c3a14b49c5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.446992] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6323e6a6-ed95-407e-85ea-b6c3a14b49c5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.448115] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6323e6a6-ed95-407e-85ea-b6c3a14b49c5',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.895914] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e025f6ff-d5c9-4f96-a784-70bf832323cc [ 1232.896160] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.896384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.896384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.896835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.896835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.896835] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e025f6ff-d5c9-4f96-a784-70bf832323cc already deleted. [ 1232.896835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e025f6ff-d5c9-4f96-a784-70bf832323cc" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.953773] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6323e6a6-ed95-407e-85ea-b6c3a14b49c5 [ 1232.953945] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.954238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.954238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.954374] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.954462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.954558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6323e6a6-ed95-407e-85ea-b6c3a14b49c5 already deleted. [ 1232.954639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6323e6a6-ed95-407e-85ea-b6c3a14b49c5" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.101133] env[65119]: INFO networking_nsxv3.common.synchronization [None req-776f1db8-9d8d-469d-bcaf-b12921b933a4 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1233.101740] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1233.102276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.102503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.102551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.102932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.103054] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.202244] env[65119]: INFO networking_nsxv3.common.synchronization [None req-0acc5f30-3961-4ec4-880a-6a71abc2ffdf tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1233.202244] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1233.202244] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.202244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.629653] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.630150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.630150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.630150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.630262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.630262] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f already deleted. [ 1233.630359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.630492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.630883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.630883] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.661568] env[65119]: INFO networking_nsxv3.common.synchronization [req-78937a37-e688-4539-89b5-90bd3c040a93 req-097bc8d7-bd88-42f4-82fe-cb9a449d8faa tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1233.662701] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1233.663279] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.663410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.663410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.663570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.663728] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.663858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.663858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.664038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.664131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.664226] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.089880] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.090436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.090810] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.091335] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.091738] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.092178] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.094016] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.094016] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.094016] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.094016] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.094016] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.094016] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.094016] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.094016] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.094016] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.094016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.115173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.115394] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1234.115600] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.115727] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.116069] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-b9e6a25c-d038-43ef-a630-24c549a77dbb taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.116273] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.116392] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.116725] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.116882] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e6a25c-d038-43ef-a630-24c549a77dbb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.156633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.156633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.156633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.156633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.156985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.156985] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f already deleted. [ 1234.156985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.169275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.169392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.169463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.169663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.169752] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.170084] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.170155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.170187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.170361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.170452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.170542] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1234.176147] env[65119]: INFO networking_nsxv3.common.synchronization [req-9eb65361-5bbf-4b10-9753-598e8cada703 req-b3dae2a0-0c24-49a1-9579-c3f03bad6e30 tempest-AttachVolumeNegativeTest-151813196 tempest-AttachVolumeNegativeTest-151813196-project-member] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1234.176674] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGHEST for action security_group_members [ 1234.177392] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.177392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.177392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.177392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.177612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.177612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.177612] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.177735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.177811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.177897] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.197724] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.197886] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.197950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.198174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.198380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.208323] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1234.622020] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.622020] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port b9e6a25c-d038-43ef-a630-24c549a77dbb not found, creating... [ 1234.622020] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.622020] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.622480] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.622480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.622480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.622834] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.623117] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.624244] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: b9e6a25c-d038-43ef-a630-24c549a77dbb is going to be created. [ 1234.644657] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.645362] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.646084] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.646084] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.646239] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.647134] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.680555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.680555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.680555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.680927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.680927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.681264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.681264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.681264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.681426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.681528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.681624] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab is going to be updated. [ 1234.719041] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.719041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.719041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.719252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.719355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.727233] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: IN_PROGRESS for 2s [ 1235.350930] env[65119]: INFO networking_nsxv3.common.synchronization [req-78937a37-e688-4539-89b5-90bd3c040a93 req-0096b4d1-6229-4f88-9244-71ecb3d7c733 service nova] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_rules [ 1235.351121] env[65119]: INFO networking_nsxv3.common.synchronization [req-78937a37-e688-4539-89b5-90bd3c040a93 req-0096b4d1-6229-4f88-9244-71ecb3d7c733 service nova] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1235.351292] env[65119]: INFO networking_nsxv3.common.synchronization [req-78937a37-e688-4539-89b5-90bd3c040a93 req-0096b4d1-6229-4f88-9244-71ecb3d7c733 service nova] Enqueued Resource ID: b9e6a25c-d038-43ef-a630-24c549a77dbb with Priority: HIGHEST for action port [ 1235.351840] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_rules [ 1235.351944] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1235.352362] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9e6a25c-d038-43ef-a630-24c549a77dbb with Priority: HIGHEST for action port [ 1235.352635] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.352772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.352862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.353092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.353149] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.354105] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.354448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9e6a25c-d038-43ef-a630-24c549a77dbb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.354649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.354821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.354890] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e6a25c-d038-43ef-a630-24c549a77dbb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.557748] env[65119]: INFO networking_nsxv3.common.synchronization [None req-93500c9e-e394-48f0-94da-b08ac858471b None None] Enqueued Resource ID: 60b6bc07-2b66-4b77-9727-d09b8f9d926d with Priority: HIGHEST for action port [ 1235.557984] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b6bc07-2b66-4b77-9727-d09b8f9d926d with Priority: HIGHEST for action port [ 1235.558525] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b6bc07-2b66-4b77-9727-d09b8f9d926d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.558525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b6bc07-2b66-4b77-9727-d09b8f9d926d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.558525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b6bc07-2b66-4b77-9727-d09b8f9d926d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.558841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b6bc07-2b66-4b77-9727-d09b8f9d926d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.558955] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b6bc07-2b66-4b77-9727-d09b8f9d926d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.856848] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.857260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.857260] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9e6a25c-d038-43ef-a630-24c549a77dbb with status ACTIVE [ 1235.857452] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.857590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.857640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.859383] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.859383] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.859383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.859383] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9e6a25c-d038-43ef-a630-24c549a77dbb is going to be updated. [ 1235.881440] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.881651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.881651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.881853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.881983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.882152] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.060857] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60b6bc07-2b66-4b77-9727-d09b8f9d926d [ 1236.061166] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.061305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.061392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.061597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.061698] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.061794] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60b6bc07-2b66-4b77-9727-d09b8f9d926d already deleted. [ 1236.061889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b6bc07-2b66-4b77-9727-d09b8f9d926d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.219090] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1236.219334] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 deletion is rescheduled due to dependency. [ 1236.219478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.219728] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.219994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.220220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.220348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.220414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.220567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.220647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.220743] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.514164] env[65119]: INFO networking_nsxv3.common.synchronization [None req-7c2b2121-3580-40ae-8365-017432ebf567 None None] Enqueued Resource ID: 30d07ad4-05e0-4740-8c09-765210e0ce50 with Priority: HIGHEST for action port [ 1236.514397] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d07ad4-05e0-4740-8c09-765210e0ce50 with Priority: HIGHEST for action port [ 1236.514780] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-30d07ad4-05e0-4740-8c09-765210e0ce50 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.514968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30d07ad4-05e0-4740-8c09-765210e0ce50" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.515198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30d07ad4-05e0-4740-8c09-765210e0ce50" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.515879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30d07ad4-05e0-4740-8c09-765210e0ce50" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.515879] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30d07ad4-05e0-4740-8c09-765210e0ce50',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.723144] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.736452] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35f68711-15e4-49bb-8405-30e4227c46ab in Status: SUCCESS [ 1236.736588] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab deletion is rescheduled due to dependency. [ 1236.736709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.017445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30d07ad4-05e0-4740-8c09-765210e0ce50 [ 1237.017720] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.017865] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.017982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.018209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.018331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.018476] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30d07ad4-05e0-4740-8c09-765210e0ce50 already deleted. [ 1237.018602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30d07ad4-05e0-4740-8c09-765210e0ce50" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.225830] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.730792] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.731053] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.731099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.731309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.731401] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.731502] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1237.771055] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.771055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.771055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.771055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.771055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.781182] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1238.686124] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-283 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.686418] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.686462] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.686703] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.686965] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.687137] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.687256] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.687468] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.687608] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.687811] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.687923] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.688042] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.688151] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.688260] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.688365] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.688495] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.709130] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.709303] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1238.709437] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.709605] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-283" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.709917] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-7a693f53-6264-4417-a004-8f527774f0c1 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.710109] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.710232] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.710490] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.710628] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a693f53-6264-4417-a004-8f527774f0c1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.212653] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.212939] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.213211] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.213527] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.213685] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.214184] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.214367] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.214490] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.214764] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.214936] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.215250] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.215411] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.215530] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.215785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.215925] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.216090] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 7a693f53-6264-4417-a004-8f527774f0c1 is going to be updated. [ 1239.244354] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.244580] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.244627] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.244894] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.245109] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.245420] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.791614] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1239.791956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.792104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.792378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.792631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.792785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.792906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.793125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.793236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.793355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.793480] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.928338] env[65119]: INFO networking_nsxv3.common.synchronization [req-43ab7527-48e3-478a-add8-5179cf88c141 req-ec1e153e-4fe1-45e1-b5c6-e9f9be55b379 service nova] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1239.928499] env[65119]: INFO networking_nsxv3.common.synchronization [req-43ab7527-48e3-478a-add8-5179cf88c141 req-ec1e153e-4fe1-45e1-b5c6-e9f9be55b379 service nova] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1239.930288] env[65119]: INFO networking_nsxv3.common.synchronization [req-43ab7527-48e3-478a-add8-5179cf88c141 req-ec1e153e-4fe1-45e1-b5c6-e9f9be55b379 service nova] Enqueued Resource ID: 7a693f53-6264-4417-a004-8f527774f0c1 with Priority: HIGHEST for action port [ 1239.930804] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_rules [ 1239.930804] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1239.931123] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a693f53-6264-4417-a004-8f527774f0c1 with Priority: HIGHEST for action port [ 1239.931447] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.931532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.931592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.931782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.931862] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.932667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.932836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.932836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.933072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.933209] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.933300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.933357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.933498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.933584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.933671] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.934414] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a693f53-6264-4417-a004-8f527774f0c1 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.934520] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.934587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.934733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.934808] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a693f53-6264-4417-a004-8f527774f0c1',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.296208] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.296400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.296445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.296672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.296853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.296960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.297058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.297270] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.297324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.297413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.297558] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.297651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.297712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.297852] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.297987] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.298094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.298196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.298287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.298363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.298446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.298537] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.436930] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.437099] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.437293] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.438239] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a693f53-6264-4417-a004-8f527774f0c1 with status ACTIVE [ 1240.438443] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.438554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.438618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.438849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.438946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.439090] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.439186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.439243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.439395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.439471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.439643] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.439734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.439795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.439962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.440015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.440099] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a693f53-6264-4417-a004-8f527774f0c1 is going to be updated. [ 1240.461812] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.462137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.462137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.462243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.462378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.462540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a693f53-6264-4417-a004-8f527774f0c1" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.801151] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15784b52-ff73-4fa3-a18b-f8082c6f3c89: rpc.has_security_group_logging(os_id): False [ 1240.819993] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.820159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.820233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.820447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.820538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.820752] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.820871] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.820935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.821097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.821173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.821345] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.821439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.821500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.821637] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.821720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.821882] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.821977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.822044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.822183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.822256] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.822340] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1240.886762] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.887055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.887055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.887190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.887334] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.899546] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1240.942109] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.445163] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.445351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.445394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.445615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.445707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.445807] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be updated. [ 1241.468243] env[65119]: INFO networking_nsxv3.common.synchronization [req-794fc5d4-7e02-4e05-90a1-2966c4506c46 req-0191370d-c33d-48c8-81f2-6881f0638703 tempest-ServerAddressesTestJSON-1918391995 tempest-ServerAddressesTestJSON-1918391995-project-member] Enqueued Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1241.469442] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1241.469771] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.469945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.470070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.470431] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.470678] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.470845] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.471213] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.471347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.471418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.471579] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.478495] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.478707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.478707] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.479025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.479025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.487742] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: IN_PROGRESS for 2s [ 1241.787122] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.787439] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-192" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.787721] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-192" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.788082] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-192" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.788791] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.788791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.788791] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.789091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.789281] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.789528] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.789669] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.789793] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.789937] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.790071] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.790206] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.790351] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.810855] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.811299] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1241.811299] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.811399] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-192" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.811667] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.811839] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.811958] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.812311] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.812454] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ad0cf3-4878-486f-ba3f-269fc2f48c6f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.975811] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.975995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.976082] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.976332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.976426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.976625] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.976726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.976808] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.977030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.977156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.977287] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd already deleted. [ 1241.977398] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.315457] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.315457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.315735] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.316147] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.316433] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.316709] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 45ad0cf3-4878-486f-ba3f-269fc2f48c6f not found, creating... [ 1242.317565] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.317565] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.317726] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.318036] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.318303] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.318747] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.319037] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.319227] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.319577] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.319764] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.319970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 45ad0cf3-4878-486f-ba3f-269fc2f48c6f is going to be created. [ 1242.343297] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.343562] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.343754] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.344142] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.344493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.344792] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.912379] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1242.912614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [req-794fc5d4-7e02-4e05-90a1-2966c4506c46 req-b9a07c56-ff36-4ba2-9143-dc16d9c0b7ee service nova] Enqueued Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_rules [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [req-794fc5d4-7e02-4e05-90a1-2966c4506c46 req-b9a07c56-ff36-4ba2-9143-dc16d9c0b7ee service nova] Enqueued Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [req-794fc5d4-7e02-4e05-90a1-2966c4506c46 req-b9a07c56-ff36-4ba2-9143-dc16d9c0b7ee service nova] Enqueued Resource ID: 45ad0cf3-4878-486f-ba3f-269fc2f48c6f with Priority: HIGHEST for action port [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_rules [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1243.062205] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ad0cf3-4878-486f-ba3f-269fc2f48c6f with Priority: HIGHEST for action port [ 1243.062649] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.062979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.063194] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.063553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.063746] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.065026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.065409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.065592] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.066080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.066345] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.066601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.066785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.067509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.067741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.067936] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.070910] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.070910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.070910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.070910] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.070910] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ad0cf3-4878-486f-ba3f-269fc2f48c6f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.498994] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1243.498994] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.499253] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.499499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.499691] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.499800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.499892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.500085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.500248] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.500393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.500519] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.570229] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.571353] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.571594] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.573285] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45ad0cf3-4878-486f-ba3f-269fc2f48c6f with status ACTIVE [ 1243.573710] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.573710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.573710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.573945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.574041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.574276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.574414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.574569] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.574782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.574877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.575838] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.576159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.576243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.576460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.576649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.576764] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45ad0cf3-4878-486f-ba3f-269fc2f48c6f is going to be updated. [ 1243.612025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.612237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.612284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.612499] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.612635] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.612795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ad0cf3-4878-486f-ba3f-269fc2f48c6f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.003253] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.072863] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.506239] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84645f68-06be-4009-8d3b-bc8402e7e9e4: rpc.has_security_group_logging(os_id): False [ 1244.525920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.526180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.526260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.526551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.526693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.527076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.527235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.527331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.527570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.527691] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.527825] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be updated. [ 1244.576690] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.576945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.577065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.578449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.578449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.578449] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd is going to be created. [ 1244.603689] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.603906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.603906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.604322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.604485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.623097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.623283] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.623375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.623570] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.624033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.625975] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: IN_PROGRESS for 2s [ 1244.636427] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: UNINITIALIZED for 2s [ 1244.893909] env[65119]: INFO networking_nsxv3.common.synchronization [req-4b7d322c-b980-4aab-9282-e475a66ebc95 req-42d52288-84c0-4373-b034-5b7432024581 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1244.894799] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGHEST for action security_group_members [ 1244.895393] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.895617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.895772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.896115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.896396] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.896614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.896754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.897066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.897259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.897452] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.957489] env[65119]: INFO networking_nsxv3.common.synchronization [req-4b7d322c-b980-4aab-9282-e475a66ebc95 req-42d52288-84c0-4373-b034-5b7432024581 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: b9e6a25c-d038-43ef-a630-24c549a77dbb with Priority: HIGHEST for action port [ 1244.958400] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9e6a25c-d038-43ef-a630-24c549a77dbb with Priority: HIGHEST for action port [ 1244.958837] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9e6a25c-d038-43ef-a630-24c549a77dbb taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.958985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.959104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.959347] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.959457] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e6a25c-d038-43ef-a630-24c549a77dbb',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.400322] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.400795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.400795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.400977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.401120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.401426] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.401533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.401665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.401899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.402021] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.402135] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be updated. [ 1245.437259] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.438818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.438912] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.439221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.439399] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.454279] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: IN_PROGRESS for 2s [ 1245.462254] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9e6a25c-d038-43ef-a630-24c549a77dbb with status ACTIVE [ 1245.462254] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.462254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.462455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.463622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.463622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.463622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.465215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.465215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.465215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.465215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.465215] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9e6a25c-d038-43ef-a630-24c549a77dbb is going to be updated. [ 1245.492189] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.492312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.492391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.492610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.492748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.492918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9e6a25c-d038-43ef-a630-24c549a77dbb" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.543130] env[65119]: INFO networking_nsxv3.common.synchronization [req-b56cf8f4-a878-42ed-8fbb-12482218e78c req-82c06a4f-ec39-4a09-aa73-202225d9a392 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1245.543554] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1245.543885] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.544573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.544689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.545708] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.546304] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.546631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.546717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.546921] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.547340] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.547340] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.955288] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.955484] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-361" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.955627] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-361" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.956126] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-361" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.956447] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.956731] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.956904] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.957243] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.957439] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.957713] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.957873] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.957978] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.958101] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.958249] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.958476] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.958752] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.986559] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.986740] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1245.986939] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.987222] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-361" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.987631] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-c106c9ff-362a-4b96-9623-6d8e5993d36d taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.987955] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.988188] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.988557] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.988700] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c106c9ff-362a-4b96-9623-6d8e5993d36d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.049434] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.049650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.049799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.050369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.050369] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.050709] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.050907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.051070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.051344] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.051507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.051657] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f already deleted. [ 1246.051834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.491563] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.491888] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.492081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.492219] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.492365] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.492519] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port c106c9ff-362a-4b96-9623-6d8e5993d36d not found, creating... [ 1246.492776] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.493019] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.493177] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.493420] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.493530] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.493901] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.494075] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.494193] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.494397] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.494525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.494662] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: c106c9ff-362a-4b96-9623-6d8e5993d36d is going to be created. [ 1246.515479] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.515718] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.516014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.516189] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.516491] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.516656] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.648541] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1246.648541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.660570] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: SUCCESS [ 1246.660760] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.661093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.661378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.661585] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.661714] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.661779] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.661931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.662065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.662173] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.662225] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.165181] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.165415] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.165467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.165764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.165981] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.166131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.166230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.166443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.166553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.166650] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.166827] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.166968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.167043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.167224] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.167367] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.167463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.167524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.167663] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.167741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.167826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.167949] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [req-b56cf8f4-a878-42ed-8fbb-12482218e78c req-37ca6c7e-d9ae-4d9c-b268-e2f24aefc9eb service nova] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [req-b56cf8f4-a878-42ed-8fbb-12482218e78c req-37ca6c7e-d9ae-4d9c-b268-e2f24aefc9eb service nova] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [req-b56cf8f4-a878-42ed-8fbb-12482218e78c req-37ca6c7e-d9ae-4d9c-b268-e2f24aefc9eb service nova] Enqueued Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1247.274572] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1247.274572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.274572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.274572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.274572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.274572] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.275516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.275516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.275516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.275516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.275516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.275516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.276050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.276050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.276050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.276207] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.277829] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c106c9ff-362a-4b96-9623-6d8e5993d36d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.277979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.277979] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.278208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.278304] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c106c9ff-362a-4b96-9623-6d8e5993d36d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.467556] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 in Status: SUCCESS [ 1247.467822] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 deletion is rescheduled due to dependency. [ 1247.467822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.672146] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd: rpc.has_security_group_logging(os_id): False [ 1247.697375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.697375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.697375] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.697375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.698122] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.698122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.698122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.698122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.698122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.698122] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd is going to be created. [ 1247.779835] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.780028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.781307] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.782224] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c106c9ff-362a-4b96-9623-6d8e5993d36d with status ACTIVE [ 1247.782427] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.782593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.782671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.782885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.783094] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.783300] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.783410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.783481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.783628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.783710] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.783981] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.784096] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.784162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.784364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.784433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.784549] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c106c9ff-362a-4b96-9623-6d8e5993d36d is going to be updated. [ 1247.796332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.796558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.796558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.796763] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.796945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.812824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.813084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.813140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.813455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.813455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.813628] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.814834] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: IN_PROGRESS for 2s [ 1248.286618] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.789621] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.790244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.790244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.790372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.790420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.790533] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be created. [ 1248.824226] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.824422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.824523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.824790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.824964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.839739] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: UNINITIALIZED for 2s [ 1249.828816] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: SUCCESS [ 1249.829181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.851554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1250.851947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.851947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.852181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.852456] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.852602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.852602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.852768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.852846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.852935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.853126] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.355562] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.485232] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1251.485410] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:3 started [ 1251.858045] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11f1ce4b-3c99-4ab5-97c2-76feb94f653f: rpc.has_security_group_logging(os_id): False [ 1251.886072] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.886292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.886355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.886553] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.886646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.886896] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.886999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.887093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.887264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.887342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.887436] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be created. [ 1251.989106] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.989324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.989478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.989903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.990148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.006649] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1252.274212] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.274440] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1254.022313] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1254.022633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.448217] env[65119]: INFO networking_nsxv3.common.synchronization [req-1411489c-3ed5-4064-93f2-c1646e53fea9 req-b27b9631-673c-4dd6-9ad4-263a147db543 tempest-ServerAddressesTestJSON-1918391995 tempest-ServerAddressesTestJSON-1918391995-project-member] Enqueued Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1256.448891] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGHEST for action security_group_members [ 1256.449272] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.449400] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.449471] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.449813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.449813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.449904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.449964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.450122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.450207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.450329] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.953419] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.953642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.953642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.953987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.954199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.954448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.954583] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.954671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.954866] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.954975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.955106] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd is going to be updated. [ 1257.000749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.000885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.000925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.001200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.001390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.012819] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: IN_PROGRESS for 2s [ 1259.024904] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd in Status: SUCCESS [ 1259.025821] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd deletion is rescheduled due to dependency. [ 1259.025821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.450277] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.450277] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1261.576728] env[65119]: INFO networking_nsxv3.common.synchronization [req-a78a5aa4-09f0-4a07-9c6c-a7ad6a544037 req-8a81c0ef-c247-41a0-8d17-33ebe7dc16d8 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1261.576947] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1261.577275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.577402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.577551] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.577668] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.580271] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.580271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.580271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.580271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.580271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.580271] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.080910] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.081243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.081243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.081532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.105804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.106091] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.106220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.106301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.106813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.106813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.106813] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1262.137820] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.137820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.137820] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.138056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.138228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.147469] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1264.159261] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1264.159722] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 deletion is rescheduled due to dependency. [ 1264.159722] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.578089] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.578441] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.506124] env[65119]: INFO networking_nsxv3.common.synchronization [req-bdd3810a-7233-46ee-a571-5b48f42ce599 req-c6add3cc-faa8-47c3-97c4-4c6325461532 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1271.506124] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1271.506124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.506124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.506124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.507803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.508092] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.811014] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.811237] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.811349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.811622] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.811877] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.812051] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.812170] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.812385] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.812525] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.812726] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.812837] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.812988] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.813094] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.813173] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.813335] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.813558] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.836484] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.836484] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1271.836484] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.836711] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.837055] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-a976b1fb-7c71-42fe-99a0-245e942f2347 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.837281] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.837436] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.837789] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.837964] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a976b1fb-7c71-42fe-99a0-245e942f2347',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.010968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.011249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.011249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.011435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.011527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.011714] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.011811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.011873] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.012069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.012154] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.012244] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1272.038277] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.038547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.038547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.038735] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.038883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.048971] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1272.340553] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.340785] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.340910] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.341222] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.341374] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.341529] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port a976b1fb-7c71-42fe-99a0-245e942f2347 not found, creating... [ 1272.341787] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.341947] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.342076] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.342303] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.342440] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.342738] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.342890] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.343014] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.343267] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.343428] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.343580] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: a976b1fb-7c71-42fe-99a0-245e942f2347 is going to be created. [ 1272.363094] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.363424] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.363709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.363876] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.364112] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.364404] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.061540] env[65119]: INFO networking_nsxv3.common.synchronization [req-bdd3810a-7233-46ee-a571-5b48f42ce599 req-ad324560-085f-4751-8697-9420b7e6b7c1 service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 1273.061807] env[65119]: INFO networking_nsxv3.common.synchronization [req-bdd3810a-7233-46ee-a571-5b48f42ce599 req-ad324560-085f-4751-8697-9420b7e6b7c1 service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1273.061957] env[65119]: INFO networking_nsxv3.common.synchronization [req-bdd3810a-7233-46ee-a571-5b48f42ce599 req-ad324560-085f-4751-8697-9420b7e6b7c1 service nova] Enqueued Resource ID: a976b1fb-7c71-42fe-99a0-245e942f2347 with Priority: HIGHEST for action port [ 1273.062749] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 1273.063017] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1273.063282] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976b1fb-7c71-42fe-99a0-245e942f2347 with Priority: HIGHEST for action port [ 1273.063680] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.063935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.064121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.064501] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.064697] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.065605] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.065758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.066026] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-a976b1fb-7c71-42fe-99a0-245e942f2347 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.066211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.066317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.066651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.066651] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a976b1fb-7c71-42fe-99a0-245e942f2347',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.441606] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.441606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.441606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.442097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.442272] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.568402] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.568686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.570981] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a976b1fb-7c71-42fe-99a0-245e942f2347 with status ACTIVE [ 1273.571206] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.571370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.571448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.571667] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.571757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.571940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.572057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.572117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.572271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.572348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.572526] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.572658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.572694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.572810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.572884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.572970] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a976b1fb-7c71-42fe-99a0-245e942f2347 is going to be updated. [ 1273.596156] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.596333] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.596373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.596575] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.596716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.596879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a976b1fb-7c71-42fe-99a0-245e942f2347" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.695501] env[65119]: INFO networking_nsxv3.common.synchronization [req-491b70f1-8a5b-41a0-b8c7-85f6808097f0 req-665abbef-3276-408f-ad24-663bc15fdd84 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1273.696051] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1273.696372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.696512] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.696568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.696754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.696911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.697017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.697072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.697223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.697309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.697397] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.945285] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.987179] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.987179] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.987349] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.987545] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.987797] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.987952] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.988091] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.988338] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.988481] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.988689] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.988799] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1273.988905] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1273.989022] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1273.989135] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.989239] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1273.989367] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.007385] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.007560] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.007693] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.007864] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-589" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.008208] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-ae1ed697-72a6-4ebb-848f-ada1077dbf24 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.008384] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.008507] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.008847] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.008980] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae1ed697-72a6-4ebb-848f-ada1077dbf24',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.061664] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1274.062078] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 deletion is rescheduled due to dependency. [ 1274.062078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.062171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.062435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.062627] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.062794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.062896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.063137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.063294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.063438] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.199513] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.447017] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.511100] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.511320] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.511413] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.511704] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.511850] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.512013] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port ae1ed697-72a6-4ebb-848f-ada1077dbf24 not found, creating... [ 1274.512312] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.512483] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.512602] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.512846] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.512986] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.513367] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.513553] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.513707] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.513975] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.514119] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.514308] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: ae1ed697-72a6-4ebb-848f-ada1077dbf24 is going to be created. [ 1274.534622] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.534861] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.534987] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.535279] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.535507] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.535733] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.566441] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.701551] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.948864] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1274.949053] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1275.068758] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.204822] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.204946] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.205211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.205482] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.205611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.205786] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1275.235893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.236059] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.236135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.236346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.236521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.245090] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1275.253189] env[65119]: INFO networking_nsxv3.common.synchronization [req-491b70f1-8a5b-41a0-b8c7-85f6808097f0 req-cd2b2979-9de2-4510-a1f1-2f0b8ddf3f52 service nova] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 1275.253410] env[65119]: INFO networking_nsxv3.common.synchronization [req-491b70f1-8a5b-41a0-b8c7-85f6808097f0 req-cd2b2979-9de2-4510-a1f1-2f0b8ddf3f52 service nova] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1275.253853] env[65119]: INFO networking_nsxv3.common.synchronization [req-491b70f1-8a5b-41a0-b8c7-85f6808097f0 req-cd2b2979-9de2-4510-a1f1-2f0b8ddf3f52 service nova] Enqueued Resource ID: ae1ed697-72a6-4ebb-848f-ada1077dbf24 with Priority: HIGHEST for action port [ 1275.258048] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_rules [ 1275.258048] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1275.258279] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae1ed697-72a6-4ebb-848f-ada1077dbf24 with Priority: HIGHEST for action port [ 1275.258591] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.258756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.258805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.258965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.259293] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.259935] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.260046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.260241] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae1ed697-72a6-4ebb-848f-ada1077dbf24 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.260414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.260414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.260578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.260655] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae1ed697-72a6-4ebb-848f-ada1077dbf24',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.572062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.572279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.572279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.572412] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.572503] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.572602] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1275.600054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.600219] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.600293] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.600491] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.600636] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.609649] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1275.726521] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.726687] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.726748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.726975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.738331] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1275.739249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.740443] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1275.762576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae1ed697-72a6-4ebb-848f-ada1077dbf24 with status ACTIVE [ 1275.762800] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.762934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.762996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.763216] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.763387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.763582] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.763685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.763748] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.763908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.763985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.764172] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.764322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.764391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.764527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.764599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.764681] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae1ed697-72a6-4ebb-848f-ada1077dbf24 is going to be updated. [ 1275.765797] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.765911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.778559] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.778559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.778775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.778881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.794478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.795282] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1275.795437] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1275.795577] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1275.798083] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.798083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.798083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.798083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.798317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.798352] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae1ed697-72a6-4ebb-848f-ada1077dbf24" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.834115] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.834378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.834378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.834541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.836027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.836210] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1276.016545] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.016817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.016817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.016965] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.017259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.017553] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1276.096610] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.097075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.097075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.097175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.097483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.097838] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1276.097957] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'11f1ce4b-3c99-4ab5-97c2-76feb94f653f', '2994e442-555a-4a06-b1c7-b7bebbd61b5f', 'cac32beb-4c24-4e53-9268-c02bfdb859d7', 'ac0d43e6-6e39-462f-b009-edd165ae1d99', 'b9c0dc90-8346-4983-bb7f-1dc141d9364f', 'e5a2a36a-9776-4e8f-af73-6d8b077adfff', '401587e3-1d61-4cfb-98f7-6ad8e08b67c0', '47ab408e-051b-41f8-8797-d5537be1217f', 'd4ea5e4f-0bd7-4db5-b843-bfd1a575efdd', 'ca2d1c57-a6bd-4f0c-9911-e018a46e3355', '75aafba1-23a9-48ba-a855-7337f0a9b868', '15784b52-ff73-4fa3-a18b-f8082c6f3c89', '943bb395-8b85-4c59-b9e0-3f26c98e1568', '52301c55-2aed-492e-b8aa-01f9cb12dce6', '84645f68-06be-4009-8d3b-bc8402e7e9e4', 'abf1fd06-b056-4d16-b440-25af92d62920', '35f68711-15e4-49bb-8405-30e4227c46ab', '154abdb7-4268-41a3-bf4b-26f5e9656c76', '11640dd0-f616-4c88-b27a-efd2c41b9114', '5e282651-46df-44c0-8922-eca67aa74d66', '13a91696-7519-44b6-b10f-fc41ed3e295d', '78855541-03b8-4d32-871e-c374cb44f414', '1befdc0c-fdef-47d8-a265-90eb419b7428', '568eca14-d302-4960-af0c-9198176e727f', '09eeb8ed-53fe-4534-ba39-d93429300967', 'a096698e-b6ff-45f7-a422-2ae93392dd6a', '511a8f2f-3767-4d34-9d44-c9a6cd510c1a', '1a40b8a7-01bb-4eb9-8b40-fe7596c9d197', '0ce292fb-ef03-4deb-8b4d-98b3ea31c815', 'ed152bbd-2522-4d15-9d17-a181bc283606', '7a32e7cc-5871-4cac-93b4-13eb1e04d001', 'eb75ad9c-4e20-475c-9f48-9dc0b70cd915', 'cec5d72a-5222-4ea2-bb61-5a248eace68e', 'cb24203d-c552-4146-a5ac-8b7d840c9508', 'e7705f38-2e46-4cc6-a745-b9fed998f2e9', '78d97212-9ce9-44c7-aea3-cb927043ab34', '07660c72-b919-4d62-b37d-9ae294d80c7d', 'd044d815-6af5-4fd9-a0b1-bc64182a7697', 'a4688087-743d-4d09-ac40-3272e1f90bc5', '77b26c46-fbab-436a-bd4d-c5014107aa41', '21f74596-fb6a-47cf-899d-a4910bf5e050', 'b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a', 'a7c347da-631c-445c-b2e6-004a6894e069', 'a698aa11-3871-4c02-b0a5-985be0e71f6d'} {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.098068] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1276.118176] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.118388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.118435] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.118640] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.118753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.118889] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1276.118970] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.119055] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1276.199465] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.199683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.199754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.199973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.201135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.201546] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1276.201693] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.201781] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1276.201854] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1276.201935] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1276.202014] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGH for action security_group_rules [ 1276.202107] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGH for action security_group_rules [ 1276.202176] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGH for action security_group_rules [ 1276.202241] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGH for action security_group_rules [ 1276.202303] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGH for action security_group_rules [ 1276.202367] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGH for action security_group_rules [ 1276.202429] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGH for action security_group_rules [ 1276.202509] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGH for action security_group_rules [ 1276.202589] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGH for action security_group_rules [ 1276.202653] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1276.202716] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGH for action security_group_rules [ 1276.202778] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGH for action security_group_rules [ 1276.202840] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGH for action security_group_rules [ 1276.202901] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGH for action security_group_rules [ 1276.202964] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGH for action security_group_rules [ 1276.203037] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGH for action security_group_rules [ 1276.203100] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGH for action security_group_rules [ 1276.203165] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 1276.203228] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGH for action security_group_rules [ 1276.203354] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGH for action security_group_rules [ 1276.203446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.258021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1277.258445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.258445] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.258800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.259040] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.259218] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.259287] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.259450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.259562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.259699] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.621312] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1277.621502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.621684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.621925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.622140] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.622258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.622322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.622468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.622546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.622627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.622716] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.762524] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.124559] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.266204] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.626849] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ce292fb-ef03-4deb-8b4d-98b3ea31c815: rpc.has_security_group_logging(os_id): False [ 1278.647463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.647686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.647739] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.647936] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.670899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.671311] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.671448] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.671541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.671768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.671857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.671955] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1278.733397] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.733565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.733651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.733853] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.734010] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.748706] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1278.768412] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.768586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.768586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.768804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.769110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.769110] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1278.803104] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.803284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.803498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.803860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.804238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.824441] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1280.259156] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.259456] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=3 [ 1280.260039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGH for action security_group_rules [ 1280.260039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 with Priority: HIGH for action security_group_rules [ 1280.260039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 with Priority: HIGH for action security_group_rules [ 1280.260039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGH for action security_group_rules [ 1280.260039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e282651-46df-44c0-8922-eca67aa74d66 with Priority: HIGH for action security_group_rules [ 1280.260384] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 with Priority: HIGH for action security_group_rules [ 1280.260384] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 with Priority: HIGH for action security_group_rules [ 1280.260384] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35f68711-15e4-49bb-8405-30e4227c46ab with Priority: HIGH for action security_group_rules [ 1280.261035] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 with Priority: HIGH for action security_group_rules [ 1280.261150] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf1fd06-b056-4d16-b440-25af92d62920 with Priority: HIGH for action security_group_rules [ 1280.261272] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGH for action security_group_rules [ 1280.261367] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 with Priority: HIGH for action security_group_rules [ 1280.261451] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 with Priority: HIGH for action security_group_rules [ 1280.261532] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1280.261684] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd with Priority: HIGH for action security_group_rules [ 1280.261802] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff with Priority: HIGH for action security_group_rules [ 1280.261900] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ab408e-051b-41f8-8797-d5537be1217f with Priority: HIGH for action security_group_rules [ 1280.261994] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f with Priority: HIGH for action security_group_rules [ 1280.262105] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f with Priority: HIGH for action security_group_rules [ 1280.262235] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 with Priority: HIGH for action security_group_rules [ 1280.262646] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.262781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.262848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.263165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.263355] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.264643] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cac32beb-4c24-4e53-9268-c02bfdb859d7 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.264833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.264944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.265308] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.265442] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cac32beb-4c24-4e53-9268-c02bfdb859d7',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.266599] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.266972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.266972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.267085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.267121] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401587e3-1d61-4cfb-98f7-6ad8e08b67c0',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.268413] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.268532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.268585] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.268740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.269314] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.269816] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e282651-46df-44c0-8922-eca67aa74d66 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.269975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.270326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.270326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.270326] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e282651-46df-44c0-8922-eca67aa74d66',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.271018] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11640dd0-f616-4c88-b27a-efd2c41b9114 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.271155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.271197] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.271365] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.271466] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11640dd0-f616-4c88-b27a-efd2c41b9114',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.272616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154abdb7-4268-41a3-bf4b-26f5e9656c76 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.272616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.272616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.272616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.272829] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154abdb7-4268-41a3-bf4b-26f5e9656c76',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.273445] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35f68711-15e4-49bb-8405-30e4227c46ab taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.273560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.273618] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.273771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.273842] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35f68711-15e4-49bb-8405-30e4227c46ab',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.274746] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52301c55-2aed-492e-b8aa-01f9cb12dce6 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.274857] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.274922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.275434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.275580] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52301c55-2aed-492e-b8aa-01f9cb12dce6',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.276205] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf1fd06-b056-4d16-b440-25af92d62920 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.276327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.276375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.276547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.276633] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf1fd06-b056-4d16-b440-25af92d62920',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.277565] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.277745] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.277794] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.277939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.278025] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.278913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.279041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.279106] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.279372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.279454] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15784b52-ff73-4fa3-a18b-f8082c6f3c89',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.280131] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75aafba1-23a9-48ba-a855-7337f0a9b868 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.280237] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.280304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.280452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.280542] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75aafba1-23a9-48ba-a855-7337f0a9b868',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.281648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.281746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.281940] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.282050] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.282179] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.282288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.282355] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.283606] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.283606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.283606] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.283789] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.283789] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5a2a36a-9776-4e8f-af73-6d8b077adfff',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.285313] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ab408e-051b-41f8-8797-d5537be1217f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.285422] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.285547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.285642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.285754] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ab408e-051b-41f8-8797-d5537be1217f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.286732] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.286802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.286839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.287070] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.287070] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9c0dc90-8346-4983-bb7f-1dc141d9364f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.289944] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.289944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.290092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.290348] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.290348] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2994e442-555a-4a06-b1c7-b7bebbd61b5f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.291086] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0d43e6-6e39-462f-b009-edd165ae1d99 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.291238] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.291271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.291429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.291503] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0d43e6-6e39-462f-b009-edd165ae1d99',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.296890] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.297309] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.297395] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.297558] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.297718] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.297817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.297880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.298030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.298118] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.298201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.298285] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.318249] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.318465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.318465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.318984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.321506] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.321631] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.340717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.340896] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e282651-46df-44c0-8922-eca67aa74d66 is going to be deleted. [ 1280.341906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.342149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.361252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.361445] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cac32beb-4c24-4e53-9268-c02bfdb859d7 is going to be deleted. [ 1280.428209] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.428452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.428452] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.428619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.428713] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.428842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cac32beb-4c24-4e53-9268-c02bfdb859d7" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.438258] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.438430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.438430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.438783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.438882] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.439016] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e282651-46df-44c0-8922-eca67aa74d66" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.763894] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1280.764943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.805442] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.805700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.805700] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.805904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.806103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.806212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.806300] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.806467] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.806572] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.806659] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.806775] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.811141] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.811299] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.811388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.811638] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.811815] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.811966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.812045] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.812230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.812316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.812571] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.812571] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.813465] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.900884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.901121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.901171] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.901617] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.903510] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.903608] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.904380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.904532] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.905262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.905375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.905999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.906140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.906843] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.906939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.907589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.907690] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.908376] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.908565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.909325] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.909446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.910108] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.910204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.910897] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.910993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.912451] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.912941] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.913116] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.913878] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.914222] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1280.914430] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.915199] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.915545] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.915660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.915807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.916056] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.916180] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.916288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.916370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.916560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.916643] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.916732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.916822] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.918162] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.918573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.918695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.929210] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.929670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.929965] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd is going to be deleted. [ 1280.930920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.931136] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.954418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.954619] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9c0dc90-8346-4983-bb7f-1dc141d9364f is going to be deleted. [ 1280.955684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.955684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.974292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.974435] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15784b52-ff73-4fa3-a18b-f8082c6f3c89 is going to be deleted. [ 1280.975983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.975983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.997137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.997299] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154abdb7-4268-41a3-bf4b-26f5e9656c76 is going to be deleted. [ 1280.998405] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.998653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.001134] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.001263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.004589] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.004589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.027889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.028030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52301c55-2aed-492e-b8aa-01f9cb12dce6 is going to be deleted. [ 1281.029064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.029326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.050429] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.050607] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf1fd06-b056-4d16-b440-25af92d62920 is going to be deleted. [ 1281.051764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.052065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.087150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.087372] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.105332] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.105332] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.112788] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.113046] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2994e442-555a-4a06-b1c7-b7bebbd61b5f is going to be deleted. [ 1281.114126] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.114771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.147772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.147985] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0d43e6-6e39-462f-b009-edd165ae1d99 is going to be deleted. [ 1281.149251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.149486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.189020] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.189223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.192632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.192830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.203529] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.203702] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.237356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.237526] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11640dd0-f616-4c88-b27a-efd2c41b9114 is going to be deleted. [ 1281.238607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.238828] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.305668] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.306025] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.306927] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.307056] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401587e3-1d61-4cfb-98f7-6ad8e08b67c0 is going to be deleted. [ 1281.307956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.308170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.318864] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11f1ce4b-3c99-4ab5-97c2-76feb94f653f: rpc.has_security_group_logging(os_id): False [ 1281.320580] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.322650] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.344034] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.344235] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.352022] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.352022] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5a2a36a-9776-4e8f-af73-6d8b077adfff is going to be deleted. [ 1281.352413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.352624] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.397317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.397518] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35f68711-15e4-49bb-8405-30e4227c46ab is going to be deleted. [ 1281.398522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.398741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.404280] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.404474] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.419947] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.432203] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.432361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75aafba1-23a9-48ba-a855-7337f0a9b868 is going to be deleted. [ 1281.433590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.433803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.458762] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.458963] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.477215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.477491] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ab408e-051b-41f8-8797-d5537be1217f is going to be deleted. [ 1281.478741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.479044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.479181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.479366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ea5e4f-0bd7-4db5-b843-bfd1a575efdd" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.480463] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.480656] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.480699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.480929] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.481062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.481241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5a2a36a-9776-4e8f-af73-6d8b077adfff" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.481440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.481664] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.481780] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.481947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9c0dc90-8346-4983-bb7f-1dc141d9364f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.482647] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.482867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.482984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.483162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15784b52-ff73-4fa3-a18b-f8082c6f3c89" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.483392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.483588] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.483705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.483869] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154abdb7-4268-41a3-bf4b-26f5e9656c76" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.484052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.484258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.484393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.484565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52301c55-2aed-492e-b8aa-01f9cb12dce6" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.484755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.484957] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.485174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.485354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf1fd06-b056-4d16-b440-25af92d62920" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.485527] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.485732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.485844] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.486026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2994e442-555a-4a06-b1c7-b7bebbd61b5f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.486220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.486444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.486559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.486731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0d43e6-6e39-462f-b009-edd165ae1d99" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.486900] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.487115] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.513178] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.513384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.537151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.537503] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.537610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.537683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.537968] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.538100] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.538315] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1281.539684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.539892] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.539986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.540124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401587e3-1d61-4cfb-98f7-6ad8e08b67c0" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.540261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.540418] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.540891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.540891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11640dd0-f616-4c88-b27a-efd2c41b9114" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.540891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.540891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.541036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.541067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35f68711-15e4-49bb-8405-30e4227c46ab" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.582279] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.582566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.582566] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.582847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.582847] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.582973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75aafba1-23a9-48ba-a855-7337f0a9b868" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.621150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.621392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.621539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.621703] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.621811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.621937] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ab408e-051b-41f8-8797-d5537be1217f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.699540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.699833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.699833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.700146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.700146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.723554] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1281.822788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 943bb395-8b85-4c59-b9e0-3f26c98e1568: rpc.has_security_group_logging(os_id): False [ 1281.823966] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84645f68-06be-4009-8d3b-bc8402e7e9e4: rpc.has_security_group_logging(os_id): False [ 1281.850448] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.850622] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.850693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.850906] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.852570] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.852681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.875049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.875216] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.875284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.875947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.875947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.875947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.875947] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be updated. [ 1281.876806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.877035] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.901446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.901791] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.901923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.901989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.902211] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.902297] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.902389] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 is going to be updated. [ 1281.922232] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2d1c57-a6bd-4f0c-9911-e018a46e3355: rpc.has_security_group_logging(os_id): False [ 1281.940768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.940954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.940954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.941199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.956670] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.956798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.963766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.963971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.966830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.967157] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.967304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.967381] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.967614] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.967716] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.967850] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1281.968881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.969133] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.969307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.970175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.970394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.970549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.985234] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: IN_PROGRESS for 2s [ 1281.987820] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: IN_PROGRESS for 2s [ 1282.072141] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.072307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.072988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.072988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.072988] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.098777] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1283.738396] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1283.738749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.999710] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: SUCCESS [ 1283.999934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.000861] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1284.001052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.113758] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1284.113971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.114166] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.114413] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.114508] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.617528] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.617528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.617528] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.617893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.617893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.618044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.618044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.618146] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.618231] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.618317] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.618407] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.120943] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.262869] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.263056] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1285.624166] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2d1c57-a6bd-4f0c-9911-e018a46e3355: rpc.has_security_group_logging(os_id): False [ 1285.644118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.644284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.644322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.644579] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.644678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.644920] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.645036] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.645104] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.645259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.645336] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.645424] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1285.704645] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.704836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.704877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.705076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.705229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.719158] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1287.735489] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1287.735856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.264089] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.264546] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.265720] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.266113] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.373027] env[65119]: INFO networking_nsxv3.common.synchronization [req-7def56df-8d80-4b18-a5eb-134022b1c9ce req-5a9e061d-7b21-4acd-91f7-19fa35b7b666 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1296.373027] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1296.373027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.373027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.373027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.373027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.373027] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.373027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.373027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.374182] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.374380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.374575] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.395865] env[65119]: INFO networking_nsxv3.common.synchronization [req-7def56df-8d80-4b18-a5eb-134022b1c9ce req-5a9e061d-7b21-4acd-91f7-19fa35b7b666 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1296.395865] env[65119]: INFO networking_nsxv3.common.synchronization [req-7def56df-8d80-4b18-a5eb-134022b1c9ce req-5a9e061d-7b21-4acd-91f7-19fa35b7b666 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1296.395865] env[65119]: INFO networking_nsxv3.common.synchronization [req-7def56df-8d80-4b18-a5eb-134022b1c9ce req-5a9e061d-7b21-4acd-91f7-19fa35b7b666 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1296.397221] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1296.397221] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1296.397221] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1296.397221] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.397221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.397221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.397221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.397221] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.398717] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.398838] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.399029] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c106c9ff-362a-4b96-9623-6d8e5993d36d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.399151] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.399192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.399370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.399450] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c106c9ff-362a-4b96-9623-6d8e5993d36d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.878058] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.902540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.902685] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.902729] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c106c9ff-362a-4b96-9623-6d8e5993d36d with status ACTIVE [ 1296.903247] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.904076] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.904076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.904357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.904357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.904516] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.904680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.904680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.904817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.904876] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.904961] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c106c9ff-362a-4b96-9623-6d8e5993d36d is going to be updated. [ 1296.929124] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.929124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.929124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.929124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.929124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.929396] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.359333] env[65119]: INFO networking_nsxv3.common.synchronization [req-954dc6d0-ff99-4ee7-ae7c-56e40a8b5a83 req-8f796f36-03ec-406c-9ae1-029fa254ffb7 tempest-AttachVolumeShelveTestJSON-396545825 tempest-AttachVolumeShelveTestJSON-396545825-project-member] Enqueued Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1297.359982] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 with Priority: HIGHEST for action security_group_members [ 1297.360438] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-84645f68-06be-4009-8d3b-bc8402e7e9e4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.360607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.360674] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.360904] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.361079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.361189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.361243] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.361461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.361559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.361656] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84645f68-06be-4009-8d3b-bc8402e7e9e4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.380069] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.863548] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.863751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.863830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.864067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.864156] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.864370] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.864486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.864546] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.864744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.864821] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.864909] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 is going to be updated. [ 1297.883380] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.883380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.883380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.883380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.883380] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.883380] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1297.895871] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.896046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.896107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.896282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.896423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.904485] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: IN_PROGRESS for 2s [ 1297.914372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.914510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.914589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.914854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.915242] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.924565] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1298.842434] env[65119]: INFO networking_nsxv3.common.synchronization [req-135bf6a4-b905-4984-a3a7-77ed1dd0b5d6 req-739a6347-0cf8-4531-a525-d93363815dd3 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1298.843012] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1298.843341] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.843444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.860062] env[65119]: INFO networking_nsxv3.common.synchronization [req-135bf6a4-b905-4984-a3a7-77ed1dd0b5d6 req-739a6347-0cf8-4531-a525-d93363815dd3 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1298.860199] env[65119]: INFO networking_nsxv3.common.synchronization [req-135bf6a4-b905-4984-a3a7-77ed1dd0b5d6 req-739a6347-0cf8-4531-a525-d93363815dd3 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1298.860361] env[65119]: INFO networking_nsxv3.common.synchronization [req-135bf6a4-b905-4984-a3a7-77ed1dd0b5d6 req-739a6347-0cf8-4531-a525-d93363815dd3 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1298.861352] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_rules [ 1298.861579] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1298.862036] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c106c9ff-362a-4b96-9623-6d8e5993d36d with Priority: HIGHEST for action port [ 1298.862500] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.862680] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.862956] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.863097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.863389] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-c106c9ff-362a-4b96-9623-6d8e5993d36d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.863655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.863655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.863935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.864068] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c106c9ff-362a-4b96-9623-6d8e5993d36d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.366503] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c106c9ff-362a-4b96-9623-6d8e5993d36d with status ACTIVE [ 1299.366723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.366860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.366930] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.367258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.367383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.367581] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.367676] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.367736] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.367895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.367975] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.368171] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.368263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.368323] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.368465] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.368555] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.368627] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c106c9ff-362a-4b96-9623-6d8e5993d36d is going to be updated. [ 1299.390768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.390768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.390768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.390768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.390768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.390768] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c106c9ff-362a-4b96-9623-6d8e5993d36d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.914477] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 in Status: SUCCESS [ 1299.914851] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84645f68-06be-4009-8d3b-bc8402e7e9e4 deletion is rescheduled due to dependency. [ 1299.914851] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84645f68-06be-4009-8d3b-bc8402e7e9e4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.933845] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1299.934072] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.934236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.934457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.934698] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.934829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.934923] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.935064] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.935148] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.935246] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.437469] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.939232] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.441631] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.441884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.441884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.442137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.442234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.442342] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1301.474891] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.475172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.475172] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.475313] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.475449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.485100] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1302.844758] env[65119]: INFO networking_nsxv3.common.synchronization [req-9072022e-919a-40a3-8778-636f7c3a270d req-a415018c-6e1b-41e4-aa72-30543346b757 tempest-AttachInterfacesUnderV243Test-1793176791 tempest-AttachInterfacesUnderV243Test-1793176791-project-member] Enqueued Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1302.845329] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f with Priority: HIGHEST for action security_group_members [ 1302.845404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.845490] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.496762] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1303.497066] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.497198] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.497373] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.497571] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.497694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.497747] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.497898] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.497974] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.498069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.498166] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.499061] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.499223] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.499374] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.499504] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.499549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.499665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.499741] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.499910] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.002057] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.003111] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.003251] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.003318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.003526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.003686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.003902] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.004017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.004091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.004258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.004337] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.004423] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1304.034888] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.035137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.035137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.035407] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.035559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.047572] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1304.507462] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11f1ce4b-3c99-4ab5-97c2-76feb94f653f: rpc.has_security_group_logging(os_id): False [ 1304.526454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.526732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.526732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.527163] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.527359] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.527652] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.527772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.527841] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.528040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.528128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.528221] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1304.592647] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.592806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.592879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.593312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.593312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.612666] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1305.664563] env[65119]: INFO networking_nsxv3.common.synchronization [req-b17596f4-ecbd-433d-8f97-f7ba6eb08507 req-fbc45b84-0002-4ac2-ad05-ba9e29f58d57 tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1305.665073] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 with Priority: HIGHEST for action security_group_members [ 1305.665073] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-943bb395-8b85-4c59-b9e0-3f26c98e1568 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.665187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.665230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.665427] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.665583] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.665681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.665744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.665914] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.666037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.666138] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943bb395-8b85-4c59-b9e0-3f26c98e1568',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.066029] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1306.066029] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f deletion is rescheduled due to dependency. [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.066029] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.066029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.066029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.168128] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.168301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.168364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.168586] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.168678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.168876] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.168972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.169052] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.169202] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.169277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.169361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 is going to be updated. [ 1306.195985] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.196189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.196189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.196397] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.196547] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.206027] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: IN_PROGRESS for 2s [ 1306.570563] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.570734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.570810] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.571040] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.571138] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.571343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.571443] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.571765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.572492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.572492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.572592] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be updated. [ 1306.600722] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.600948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.601041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.601254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.601404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.611088] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: IN_PROGRESS for 2s [ 1306.627562] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1306.627562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.627909] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.628241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.629193] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.154616] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.155078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.155078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.155208] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.155326] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.155431] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be deleted. [ 1307.217767] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.217954] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.218038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.218245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.218342] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.218461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.217846] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 in Status: SUCCESS [ 1308.218183] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943bb395-8b85-4c59-b9e0-3f26c98e1568 deletion is rescheduled due to dependency. [ 1308.218183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943bb395-8b85-4c59-b9e0-3f26c98e1568" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.622016] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f in Status: SUCCESS [ 1308.622309] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f deletion is rescheduled due to dependency. [ 1308.622426] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.622595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.622823] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.623023] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.623162] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.623221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.623385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.623480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.623584] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f1ce4b-3c99-4ab5-97c2-76feb94f653f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.126400] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.126584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.126686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.126949] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.127085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.127327] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.127461] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.127548] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.127711] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.127791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.127877] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f1ce4b-3c99-4ab5-97c2-76feb94f653f is going to be deleted. [ 1309.156491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.156610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.156610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.156826] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.156920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.157026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f1ce4b-3c99-4ab5-97c2-76feb94f653f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.665750] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.666071] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.703866] env[65119]: INFO networking_nsxv3.common.synchronization [None req-247a61b3-0cf6-49f4-9108-91eba862bae7 tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1311.704407] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1311.704723] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.704842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.704908] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.705193] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.705276] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.780329] env[65119]: INFO networking_nsxv3.common.synchronization [None req-aecb6048-cde2-4e83-91de-2e2e0d127d4b tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1311.780878] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1311.781253] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.781392] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.228079] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.228259] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.228339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.228544] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.228633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.228759] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 already deleted. [ 1312.228816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.228947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.229121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.229202] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.749046] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.749046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.749046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.749498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.749498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.749498] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 already deleted. [ 1312.749498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.781867] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.782194] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.210741] env[65119]: INFO networking_nsxv3.common.synchronization [req-4a4bd8b7-dcc0-44cd-89f2-ccdeaa4d320d req-41a3fe03-19df-4096-a480-35d4808b83db tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1317.211780] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1317.212384] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.212384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.212384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.212677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.212801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.212950] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.213028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.213232] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.213351] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.213474] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.475747] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.475982] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.476135] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.476398] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.476650] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.476837] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.476964] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.477197] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.477343] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.477563] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1317.477674] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1317.477783] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1317.477891] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1317.478006] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1317.478119] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1317.478251] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1317.497810] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1317.497968] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1317.498117] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1317.498285] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-994" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.498577] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-70b5809c-094a-4fee-ae27-d19d68609553 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.498743] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.498866] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.499221] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.499363] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b5809c-094a-4fee-ae27-d19d68609553',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.715884] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.716227] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.716335] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.716620] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.717324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.717324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.717324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.717324] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.717733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.717733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.717733] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 already deleted. [ 1317.717733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.001819] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.002471] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.002471] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.002710] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.003080] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.003295] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port 70b5809c-094a-4fee-ae27-d19d68609553 not found, creating... [ 1318.003616] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.003903] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.004055] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.004312] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.004457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.004796] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.005035] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.005164] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.005457] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.005599] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.005747] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: 70b5809c-094a-4fee-ae27-d19d68609553 is going to be created. [ 1318.026449] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.026682] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.026764] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.027058] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.027292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.027523] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.720413] env[65119]: INFO networking_nsxv3.common.synchronization [req-4a4bd8b7-dcc0-44cd-89f2-ccdeaa4d320d req-afff372f-c3a5-4256-a2c7-fb3a088be1e1 service nova] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1318.720734] env[65119]: INFO networking_nsxv3.common.synchronization [req-4a4bd8b7-dcc0-44cd-89f2-ccdeaa4d320d req-afff372f-c3a5-4256-a2c7-fb3a088be1e1 service nova] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1318.720901] env[65119]: INFO networking_nsxv3.common.synchronization [req-4a4bd8b7-dcc0-44cd-89f2-ccdeaa4d320d req-afff372f-c3a5-4256-a2c7-fb3a088be1e1 service nova] Enqueued Resource ID: 70b5809c-094a-4fee-ae27-d19d68609553 with Priority: HIGHEST for action port [ 1318.721451] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_rules [ 1318.721592] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1318.721750] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b5809c-094a-4fee-ae27-d19d68609553 with Priority: HIGHEST for action port [ 1318.722051] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.722206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.722284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.722518] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.722601] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.723664] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.723817] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.723889] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.724107] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.724248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.724354] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.724414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.724559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.724642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.724760] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.725537] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-70b5809c-094a-4fee-ae27-d19d68609553 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.725670] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.725783] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.725835] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.725944] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b5809c-094a-4fee-ae27-d19d68609553',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.227670] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.228817] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.228918] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.229094] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70b5809c-094a-4fee-ae27-d19d68609553 with status ACTIVE [ 1319.229246] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.229349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.229406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.229601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.229686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.229849] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.229944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.230017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.230272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.230449] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.230601] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.230709] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.230795] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.230917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.230991] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.231220] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70b5809c-094a-4fee-ae27-d19d68609553 is going to be updated. [ 1319.253906] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.254069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.254128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.254325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.254462] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.254642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70b5809c-094a-4fee-ae27-d19d68609553" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.733063] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.239164] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.239516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.239516] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.239720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.239854] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.239978] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 is going to be created. [ 1320.265744] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.265744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.265744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.265744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.265744] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.275906] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: UNINITIALIZED for 2s [ 1322.286927] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: SUCCESS [ 1322.287254] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.287330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.287554] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.287856] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.287986] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.288058] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.288221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.288330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.288439] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.288553] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.791937] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.293948] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52318c6e-1af4-41b6-9118-fc6c36218f72: rpc.has_security_group_logging(os_id): False [ 1323.311911] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.312200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.312200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.312367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.312463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.312707] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.312812] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.312885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.313091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.313170] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.313256] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 is going to be created. [ 1323.379507] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.379731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.379731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.379920] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.380121] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.393651] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: IN_PROGRESS for 2s [ 1323.722688] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.722886] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1325.407541] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: SUCCESS [ 1325.407948] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.724573] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.725072] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.726054] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.726418] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.726874] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.727307] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.574236] env[65119]: INFO networking_nsxv3.common.synchronization [req-786ff193-af1a-4c53-817b-3f256070c690 req-ecda15f1-6cb4-4050-85be-c569287cf8d1 tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1339.574850] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1339.575103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.575229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.575339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.575488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.575642] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.575743] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.575806] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.575951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.576049] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.576151] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.078424] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.580826] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.083454] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.083830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.083830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.083911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.084031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.084147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1341.114118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.114290] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.114363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.114568] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.114717] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.123566] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1343.135047] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1343.135437] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.575690] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.575690] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.576493] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.576867] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.441365] env[65119]: INFO networking_nsxv3.common.synchronization [req-999c8790-5638-4d6b-8162-08e885cf49c6 req-ba96983b-a4bf-4258-93b3-1349f1dbea82 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1350.441945] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1350.442283] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.442486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.442486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.442734] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.442999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.443207] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.443322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.443712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.443712] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.443712] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.945978] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.946406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.946406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.946406] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.946524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.946688] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.946798] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.946885] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.947343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.947343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.947343] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1350.974682] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.974919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.974919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.975130] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.975206] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.983336] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1352.994728] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1352.995129] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 deletion is rescheduled due to dependency. [ 1352.995129] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.443808] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.444038] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.834403] env[65119]: INFO networking_nsxv3.common.synchronization [req-40f4de8d-10cf-4465-a9cd-f5154ffbda07 req-c8a1d51e-3820-4c89-9667-de40dbb95cfa tempest-ServerActionsTestOtherA-2029239028 tempest-ServerActionsTestOtherA-2029239028-project-member] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1355.834548] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGHEST for action security_group_members [ 1355.834781] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.834902] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.834967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.835749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.835749] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.835749] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.835967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.835967] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.836057] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.836155] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.338995] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.339316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.339316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.339500] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.339601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.339801] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.339899] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.339960] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.340142] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.340221] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.340304] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be updated. [ 1356.371611] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.371813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.371813] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.372718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.372718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.382393] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: IN_PROGRESS for 2s [ 1358.114604] env[65119]: INFO networking_nsxv3.common.synchronization [req-543eed80-1ccc-4c1e-a3b9-9f43e28c9e3c req-90cacc04-a98a-4cf3-a5f7-4b42833e9ed7 tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1358.115271] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1358.115633] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.115784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.115858] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.116292] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.116464] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.116600] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.116671] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.116893] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.116933] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.117058] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.393984] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 in Status: SUCCESS [ 1358.394323] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 deletion is rescheduled due to dependency. [ 1358.394483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.400963] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.401163] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.401292] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.401644] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.401903] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.402094] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.402215] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.402429] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.402567] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.402770] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.402911] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1358.403108] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1358.403320] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1358.403445] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.403604] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1358.403742] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1358.422465] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1358.422627] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1358.422750] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1358.422897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-383" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.423225] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-32a1b552-ed48-4d18-96a2-e5cdfe000d34 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.423395] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.423513] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.423828] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.423963] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a1b552-ed48-4d18-96a2-e5cdfe000d34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.619913] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.620187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.620187] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.620378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.620472] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.620669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.620766] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.620831] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.620981] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.621069] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.621158] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1358.651193] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.651402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.651402] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.651593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.651737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.660619] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1358.926416] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.926647] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.926699] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.926970] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.927135] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.927292] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 32a1b552-ed48-4d18-96a2-e5cdfe000d34 not found, creating... [ 1358.927555] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.927719] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.927835] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.928081] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.928222] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.928507] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.928663] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.928780] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.929010] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.929152] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.929292] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 32a1b552-ed48-4d18-96a2-e5cdfe000d34 is going to be created. [ 1358.952153] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.952409] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.952544] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.952836] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.953075] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.953305] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.632678] env[65119]: INFO networking_nsxv3.common.synchronization [req-543eed80-1ccc-4c1e-a3b9-9f43e28c9e3c req-0f750ae4-5456-460a-9352-6d125dee2905 service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 1359.632934] env[65119]: INFO networking_nsxv3.common.synchronization [req-543eed80-1ccc-4c1e-a3b9-9f43e28c9e3c req-0f750ae4-5456-460a-9352-6d125dee2905 service nova] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1359.633013] env[65119]: INFO networking_nsxv3.common.synchronization [req-543eed80-1ccc-4c1e-a3b9-9f43e28c9e3c req-0f750ae4-5456-460a-9352-6d125dee2905 service nova] Enqueued Resource ID: 32a1b552-ed48-4d18-96a2-e5cdfe000d34 with Priority: HIGHEST for action port [ 1359.633245] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_rules [ 1359.633377] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1359.633474] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32a1b552-ed48-4d18-96a2-e5cdfe000d34 with Priority: HIGHEST for action port [ 1359.634060] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.634210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.634304] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.634510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.634593] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.635826] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.635922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.636131] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-32a1b552-ed48-4d18-96a2-e5cdfe000d34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.636236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.636325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.636523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.636608] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a1b552-ed48-4d18-96a2-e5cdfe000d34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.138963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.139117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.139216] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32a1b552-ed48-4d18-96a2-e5cdfe000d34 with status ACTIVE [ 1360.139388] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.139496] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.139563] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.141591] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.141591] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.141591] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.141591] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32a1b552-ed48-4d18-96a2-e5cdfe000d34 is going to be updated. [ 1360.163626] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.163842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.163842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.164076] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.164252] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.164416] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32a1b552-ed48-4d18-96a2-e5cdfe000d34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.669751] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1360.670127] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 deletion is rescheduled due to dependency. [ 1360.670127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.670731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.670731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.670731] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.670731] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.671027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.671027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.671027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.671115] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.173230] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.675578] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.179774] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.179774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.179774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.179774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.179774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.179774] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1362.211768] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.211935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.212017] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.212239] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.212382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.222189] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1364.235868] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1364.236269] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.236684] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.236951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.237248] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.237375] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.237442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.237602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.237688] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.237772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.237869] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.634835] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.635130] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1364.740778] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.244035] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ce292fb-ef03-4deb-8b4d-98b3ea31c815: rpc.has_security_group_logging(os_id): False [ 1365.264028] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.264286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.264286] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.264507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.264604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.264854] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.264955] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.265031] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.265192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.265262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.265367] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1365.329275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.329505] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.329625] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.329862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.330039] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.346316] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1367.361300] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1367.361723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.635719] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.636156] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.636920] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.637393] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.638468] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.638840] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.639754] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.640156] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.640901] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.641306] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.642293] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.642726] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.654321] env[65119]: INFO networking_nsxv3.common.synchronization [req-97da9f44-3745-495f-8dfa-28f13d5ffc7c req-6581b2e7-0ceb-458e-8e4c-f563b1ae8835 tempest-AttachVolumeTestJSON-2120593525 tempest-AttachVolumeTestJSON-2120593525-project-member] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1395.654677] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGHEST for action security_group_members [ 1395.655015] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.655149] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.655215] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.655602] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.655602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.655723] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.655765] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.655905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.655993] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.656100] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.158242] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.158473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.158473] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.158771] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.158895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.159125] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.159272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.159364] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.159639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.159639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.159738] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 is going to be updated. [ 1396.191165] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.191165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.191165] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.191487] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.191634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.201260] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: IN_PROGRESS for 2s [ 1398.212788] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 in Status: SUCCESS [ 1398.213190] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 deletion is rescheduled due to dependency. [ 1398.213190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.655468] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.655468] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.656163] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.656546] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.657371] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.658128] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.658988] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.659467] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.660534] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.660915] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.092263] env[65119]: INFO networking_nsxv3.common.synchronization [req-731a8493-d226-4ace-b9d0-484bb16ac561 req-16d09081-b0cf-46c9-8a8c-d4b51457ee2f tempest-ServerActionsTestJSON-1302388731 tempest-ServerActionsTestJSON-1302388731-project-member] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1421.092263] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGHEST for action security_group_members [ 1421.092263] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.092263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.092263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.092263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.092263] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.092896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.092896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.092896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.092896] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.092896] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.596097] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.596343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.596343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.596463] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.596582] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.596798] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.596922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.596984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.597384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.597384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.597384] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be updated. [ 1421.625964] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.626200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.626200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.626394] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.626540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.634548] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: IN_PROGRESS for 2s [ 1423.646222] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 in Status: SUCCESS [ 1423.646672] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 deletion is rescheduled due to dependency. [ 1423.646672] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.092075] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.092450] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.275486] env[65119]: INFO networking_nsxv3.common.synchronization [None req-957b225b-857f-4efc-8a1a-82691c5492f1 None None] Enqueued Resource ID: 5707ea3d-aadc-4fc7-be87-91b6bd5f07c4 with Priority: HIGHEST for action port [ 1429.275783] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5707ea3d-aadc-4fc7-be87-91b6bd5f07c4 with Priority: HIGHEST for action port [ 1429.276403] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-5707ea3d-aadc-4fc7-be87-91b6bd5f07c4 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.276403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5707ea3d-aadc-4fc7-be87-91b6bd5f07c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.276403] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5707ea3d-aadc-4fc7-be87-91b6bd5f07c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.276601] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5707ea3d-aadc-4fc7-be87-91b6bd5f07c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.276601] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5707ea3d-aadc-4fc7-be87-91b6bd5f07c4',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.778837] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5707ea3d-aadc-4fc7-be87-91b6bd5f07c4 [ 1429.779151] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.779330] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.779425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.779679] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.779829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.779932] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5707ea3d-aadc-4fc7-be87-91b6bd5f07c4 already deleted. [ 1429.780033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5707ea3d-aadc-4fc7-be87-91b6bd5f07c4" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.024765] env[65119]: INFO networking_nsxv3.common.synchronization [None req-621aaa67-07a7-4e14-9e5d-fbd52b5503c5 None None] Enqueued Resource ID: fd28f9f1-f555-4087-b4a8-4f73c82ca645 with Priority: HIGHEST for action port [ 1431.025058] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd28f9f1-f555-4087-b4a8-4f73c82ca645 with Priority: HIGHEST for action port [ 1431.025372] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd28f9f1-f555-4087-b4a8-4f73c82ca645 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.025919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd28f9f1-f555-4087-b4a8-4f73c82ca645" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.026062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd28f9f1-f555-4087-b4a8-4f73c82ca645" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.026331] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd28f9f1-f555-4087-b4a8-4f73c82ca645" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.026421] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd28f9f1-f555-4087-b4a8-4f73c82ca645',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.528643] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd28f9f1-f555-4087-b4a8-4f73c82ca645 [ 1431.528838] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.528972] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.529078] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.529294] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.529382] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.529492] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd28f9f1-f555-4087-b4a8-4f73c82ca645 already deleted. [ 1431.529610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd28f9f1-f555-4087-b4a8-4f73c82ca645" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.229019] env[65119]: INFO networking_nsxv3.common.synchronization [req-096cc5f5-ccec-4280-8d94-bb3df206e795 req-9635dbbd-5092-4fca-87ff-4292e237b8b8 tempest-ServersNegativeTestJSON-429590187 tempest-ServersNegativeTestJSON-429590187-project-member] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1434.229459] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1434.229766] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.229887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.229962] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.230233] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.230384] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.230485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.230549] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.230699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.230782] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.230875] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.544504] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.544672] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.544672] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.545044] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.545434] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.545517] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.546151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.546151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.546151] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.546759] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1434.546759] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1434.546759] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1434.546759] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1434.546759] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1434.546956] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1434.546993] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1434.570795] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1434.570795] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1434.571041] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1434.571933] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.571933] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-0f535fdd-21d8-4db4-b004-9374d21094a8 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.571933] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.571933] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.572414] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.572565] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f535fdd-21d8-4db4-b004-9374d21094a8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.732862] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.733192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.733192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.733353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.733353] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.733555] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.733678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.733742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.733856] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.733932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.734030] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f already deleted. [ 1434.734110] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.074883] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.075228] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.075360] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.075620] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.075766] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.075933] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Segment Port 0f535fdd-21d8-4db4-b004-9374d21094a8 not found, creating... [ 1435.076238] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.076395] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.076513] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.076735] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.076873] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.077165] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.077321] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.077440] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.077646] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.077781] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.077920] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 is going to be created. [ 1435.098142] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.098430] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.098555] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.098851] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.099113] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.099371] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.786530] env[65119]: INFO networking_nsxv3.common.synchronization [req-096cc5f5-ccec-4280-8d94-bb3df206e795 req-82999fcb-dfb6-47cd-aa7e-a1d4c8ea0b57 service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1435.786827] env[65119]: INFO networking_nsxv3.common.synchronization [req-096cc5f5-ccec-4280-8d94-bb3df206e795 req-82999fcb-dfb6-47cd-aa7e-a1d4c8ea0b57 service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1435.786867] env[65119]: INFO networking_nsxv3.common.synchronization [req-096cc5f5-ccec-4280-8d94-bb3df206e795 req-82999fcb-dfb6-47cd-aa7e-a1d4c8ea0b57 service nova] Enqueued Resource ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 with Priority: HIGHEST for action port [ 1435.787422] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1435.787589] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1435.787698] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 with Priority: HIGHEST for action port [ 1435.787983] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.788122] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.788192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.788436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.788519] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.789458] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.789595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.789595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.789753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.789934] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.790043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.790043] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.790188] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.790271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.792164] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.792164] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f535fdd-21d8-4db4-b004-9374d21094a8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.792164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.792164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.792164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.792164] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f535fdd-21d8-4db4-b004-9374d21094a8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.293963] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.294196] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.294322] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.295150] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f535fdd-21d8-4db4-b004-9374d21094a8 with status ACTIVE [ 1436.295329] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.295442] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.295507] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.295705] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.295791] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.295997] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.296128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.296176] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.297229] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.297229] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.297229] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 is going to be updated. [ 1436.316950] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.317186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.317186] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.317358] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.317492] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.317646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.798680] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.300879] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.301067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.301131] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.301346] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.301436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.301531] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be created. [ 1437.326464] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.326695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.326695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.326867] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.327019] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.335500] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: UNINITIALIZED for 2s [ 1439.346203] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1439.346562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.346562] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.346790] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.346983] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.347125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.347204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.347370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.347454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.347543] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.347632] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.850572] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.850807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.850807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.851084] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.851275] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.851447] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.851524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.851726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.851824] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.851935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.852119] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.852220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.852282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.852460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.852573] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.852665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.852758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.853433] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.853525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.853615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.853713] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.357070] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0aa7f6-2744-4386-a933-45a3c921090f: rpc.has_security_group_logging(os_id): False [ 1440.375116] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.375355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.375355] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.375565] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.375658] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.375893] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.376028] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.376101] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.376260] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.376339] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.376519] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.376615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.376678] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.376815] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.376891] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.377082] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.377199] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.377302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.377457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.377535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.377622] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be created. [ 1440.436994] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.437241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.437241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.437468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.437651] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.449886] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1440.788988] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.789209] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1442.466370] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1442.466862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.790410] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.790771] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.301876] env[65119]: INFO networking_nsxv3.common.synchronization [req-cb22af5d-fec4-40ed-85ea-b380a523c5c9 req-da378f45-c92f-45db-a842-4524f312ec1d tempest-ServersNegativeTestJSON-429590187 tempest-ServersNegativeTestJSON-429590187-project-member] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1448.302442] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1448.302779] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.302881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.302943] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.303318] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.303449] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.303557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.303619] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.303775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.303859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.303951] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.591734] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.591991] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.592073] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.592337] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.592592] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.592744] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.592855] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.593103] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.593243] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.593447] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1448.593558] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1448.593664] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1448.593769] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1448.593877] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1448.593980] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1448.594125] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1448.616486] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1448.616665] env[65119]: DEBUG dogpile.cache.region [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1448.616849] env[65119]: DEBUG dogpile.lock [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1448.616951] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.617276] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock port-d68c0446-c967-40fb-9984-744ad3f9daf8 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.617449] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.617569] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.617891] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.618044] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68c0446-c967-40fb-9984-744ad3f9daf8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.806496] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.120116] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.120394] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.120508] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.120707] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.120856] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.121021] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Segment Port d68c0446-c967-40fb-9984-744ad3f9daf8 not found, creating... [ 1449.121531] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.121531] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.121695] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.121756] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.121941] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.122177] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.122709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.122709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.122709] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.122855] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.123088] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Resource: SegmentPort with ID: d68c0446-c967-40fb-9984-744ad3f9daf8 is going to be created. [ 1449.143682] env[65119]: DEBUG networking_nsxv3.common.locking [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.143958] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.144038] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.144285] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.144519] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.144741] env[65119]: DEBUG oslo_concurrency.lockutils [None req-86b9606f-4938-457d-b9fc-67c1c8d79518 None None] Releasing lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.309276] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.811924] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.812175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.812175] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.813048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.813048] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.813048] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1449.842872] env[65119]: INFO networking_nsxv3.common.synchronization [req-cb22af5d-fec4-40ed-85ea-b380a523c5c9 req-f8d8a9bb-a58d-45a4-9b7d-18aacb91b06a service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1449.843084] env[65119]: INFO networking_nsxv3.common.synchronization [req-cb22af5d-fec4-40ed-85ea-b380a523c5c9 req-f8d8a9bb-a58d-45a4-9b7d-18aacb91b06a service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1449.843231] env[65119]: INFO networking_nsxv3.common.synchronization [req-cb22af5d-fec4-40ed-85ea-b380a523c5c9 req-f8d8a9bb-a58d-45a4-9b7d-18aacb91b06a service nova] Enqueued Resource ID: d68c0446-c967-40fb-9984-744ad3f9daf8 with Priority: HIGHEST for action port [ 1449.844937] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.845125] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.845200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.845404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.845683] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.846997] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1449.847157] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1449.847260] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d68c0446-c967-40fb-9984-744ad3f9daf8 with Priority: HIGHEST for action port [ 1449.848660] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.848660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.848822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.848935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.849137] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.850078] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.850210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.850376] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-d68c0446-c967-40fb-9984-744ad3f9daf8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.850495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.850653] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.851034] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.851034] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68c0446-c967-40fb-9984-744ad3f9daf8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.863420] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1450.353667] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d68c0446-c967-40fb-9984-744ad3f9daf8 with status ACTIVE [ 1450.353667] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.354132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.354132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.354132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.354132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.354324] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.354468] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.354590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.354696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.354775] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.354962] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.355092] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.355158] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.355288] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.355360] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.355446] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d68c0446-c967-40fb-9984-744ad3f9daf8 is going to be updated. [ 1450.356634] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.356805] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.375933] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.376192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.376192] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.376322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.376493] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.376689] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d68c0446-c967-40fb-9984-744ad3f9daf8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.873524] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1451.873524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.875150] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.875150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.875150] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.376885] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.879597] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.381557] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.381803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.381803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.381919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.382029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.382136] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1453.412062] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.412062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.412062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.412062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.412062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.421147] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1454.848453] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.848871] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1455.431533] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1455.431730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.431907] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.432124] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.432351] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.432521] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.432589] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.432751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.432834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.432922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.433025] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.935853] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.936385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.936385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.936385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.936531] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.936655] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.936720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.936849] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.936935] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.937038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.937191] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.937285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.937423] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.937522] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.937654] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.937742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.937804] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.937939] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.938026] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.938103] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.938208] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.440755] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0aa7f6-2744-4386-a933-45a3c921090f: rpc.has_security_group_logging(os_id): False [ 1456.458315] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.458540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.458540] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.458750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.458842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.459077] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.459183] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.459249] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.459404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.459483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.459660] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.459755] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.459818] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.459956] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.460044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.460233] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.460325] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.460384] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.460524] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.460599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.460686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1456.521205] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.521420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.521420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.521604] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.521800] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.533576] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1458.549474] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1458.549837] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.849854] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.850185] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.870183] env[65119]: INFO networking_nsxv3.common.synchronization [req-a61343b8-4631-42e8-b6b4-852cdd87294a req-5a943ae5-7fd9-463e-9f91-d34771afad07 tempest-ServersNegativeTestJSON-429590187 tempest-ServersNegativeTestJSON-429590187-project-member] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1459.870752] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1459.871085] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.871212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.871282] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.871488] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.871641] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.871737] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.871799] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.871944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.872033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.872128] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.375479] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.877894] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.380941] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.381150] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.381201] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.381486] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.381599] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.381702] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1461.411632] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.411784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.411840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.412080] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.412263] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.420603] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1463.432173] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1463.432541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.872180] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.872600] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.873039] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.873387] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.874533] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.874931] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.876537] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.876843] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.877916] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.878377] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.879321] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.879321] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.486547] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1491.486940] env[65119]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-09c47b7f-03a4-4546-aad9-e219e36ea6ad None None] NSXv3 Agent Agent loop - iteration:4 started [ 1494.880148] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.880520] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.881762] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.881762] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.092028] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.092286] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.092463] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.092762] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.093074] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.093291] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.093480] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.093735] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.093914] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.094164] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1500.094310] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] NeedRegenerationException {{(pid=65119) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1500.094444] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] no value, waiting for create lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1500.094576] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] value creation lock acquired {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1500.094715] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] No value present for key: 'zone-id' {{(pid=65119) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1500.094846] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Calling creation function for not-yet-present value {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1500.095176] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1500.116015] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1500.116208] env[65119]: DEBUG dogpile.cache.region [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65119) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1500.116321] env[65119]: DEBUG dogpile.lock [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Released creation lock {{(pid=65119) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1500.116493] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "network-654" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.116841] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock port-0f535fdd-21d8-4db4-b004-9374d21094a8 taken with stack trace [, , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.117029] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.117153] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.117412] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.117548] env[65119]: DEBUG networking_nsxv3.api.rpc [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f535fdd-21d8-4db4-b004-9374d21094a8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.620664] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.620920] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.621073] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.621318] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.621471] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.621762] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.621921] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.622050] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.622302] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.622401] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.622722] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.622882] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.623009] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.623223] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.623352] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.623492] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Resource: SegmentPort with ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 is going to be updated. [ 1500.643675] env[65119]: DEBUG networking_nsxv3.common.locking [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.643897] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.643951] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.644219] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.644404] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.644623] env[65119]: DEBUG oslo_concurrency.lockutils [None req-28151623-ccf4-4bf5-8040-05e327bca13b None None] Releasing lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [req-47d9b86e-80f2-42f5-9cf6-c963296e6d4d req-3e8294e0-6e68-44a6-a01c-6b97119bfad9 service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [req-47d9b86e-80f2-42f5-9cf6-c963296e6d4d req-3e8294e0-6e68-44a6-a01c-6b97119bfad9 service nova] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [req-47d9b86e-80f2-42f5-9cf6-c963296e6d4d req-3e8294e0-6e68-44a6-a01c-6b97119bfad9 service nova] Enqueued Resource ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 with Priority: HIGHEST for action port [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_rules [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1501.316404] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 with Priority: HIGHEST for action port [ 1501.316404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.316404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.316404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.317511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.317707] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.319505] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.319762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.319932] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.320212] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.320457] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.320682] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.320860] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.321120] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.321312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.321739] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.322604] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f535fdd-21d8-4db4-b004-9374d21094a8 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.323073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.323245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.323593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.324361] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f535fdd-21d8-4db4-b004-9374d21094a8',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.825285] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.825454] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.825665] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.826601] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f535fdd-21d8-4db4-b004-9374d21094a8 with status ACTIVE [ 1501.826813] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.826944] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.827029] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.827200] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.827307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.827446] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.827560] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.827646] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.827746] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.827822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.827991] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.828127] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.828204] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.828285] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.828356] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.828437] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f535fdd-21d8-4db4-b004-9374d21094a8 is going to be updated. [ 1501.850232] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.850480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.850480] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.850639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.850753] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.850917] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f535fdd-21d8-4db4-b004-9374d21094a8" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.330816] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.833988] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.834271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.834271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.834457] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.834590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.834685] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1502.872584] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.872836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.872836] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.873027] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.873169] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.888595] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1504.900152] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1504.900590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.900590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.900720] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.900915] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.901047] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.901111] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.901264] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.901390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.901446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.901506] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.404114] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.404393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.404393] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.404567] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.404737] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.404840] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.404905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.405067] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.405155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.405244] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.405389] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.405483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.405536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.405733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.405872] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.405964] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.406032] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.406164] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.406230] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.406312] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.406404] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.909521] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0aa7f6-2744-4386-a933-45a3c921090f: rpc.has_security_group_logging(os_id): False [ 1505.927350] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.927590] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.927642] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.927951] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.928079] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.928354] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.928495] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.928597] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.928801] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.928931] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.929169] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.929289] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.929367] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.929536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.929633] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.929828] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.929925] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.929987] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.930174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.930262] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.930365] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1505.996410] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.996677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.996742] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.996966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.997139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.031966] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1506.317090] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.317283] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1508.054017] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1508.054417] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.318730] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.319168] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1513.444942] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.445557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.445557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.445557] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.445557] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.947624] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.449861] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.952840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1514.952840] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1515.856704] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.857236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.857236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.857236] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.016560] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1516.017514] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.018793] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1516.067179] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.067470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.067470] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.067639] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.082947] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.083929] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1516.084024] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.084122] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1516.123520] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.123773] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.123883] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.124135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.124926] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.125113] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1516.320234] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.320466] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.414971] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.415222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.415222] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.415450] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.415785] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.416114] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1516.511215] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.511434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.511434] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.511660] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.511983] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.512317] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:29. [ 1516.512412] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0d0aa7f6-2744-4386-a933-45a3c921090f', '13a91696-7519-44b6-b10f-fc41ed3e295d', '52318c6e-1af4-41b6-9118-fc6c36218f72', '78855541-03b8-4d32-871e-c374cb44f414', '1befdc0c-fdef-47d8-a265-90eb419b7428', '568eca14-d302-4960-af0c-9198176e727f', '09eeb8ed-53fe-4534-ba39-d93429300967', 'a096698e-b6ff-45f7-a422-2ae93392dd6a', '511a8f2f-3767-4d34-9d44-c9a6cd510c1a', '1a40b8a7-01bb-4eb9-8b40-fe7596c9d197', '0ce292fb-ef03-4deb-8b4d-98b3ea31c815', 'ed152bbd-2522-4d15-9d17-a181bc283606', '7a32e7cc-5871-4cac-93b4-13eb1e04d001', 'eb75ad9c-4e20-475c-9f48-9dc0b70cd915', 'cec5d72a-5222-4ea2-bb61-5a248eace68e', 'cb24203d-c552-4146-a5ac-8b7d840c9508', 'e7705f38-2e46-4cc6-a745-b9fed998f2e9', '78d97212-9ce9-44c7-aea3-cb927043ab34', 'ca2d1c57-a6bd-4f0c-9911-e018a46e3355', '77b26c46-fbab-436a-bd4d-c5014107aa41', '943bb395-8b85-4c59-b9e0-3f26c98e1568', '07660c72-b919-4d62-b37d-9ae294d80c7d', 'd044d815-6af5-4fd9-a0b1-bc64182a7697', 'a4688087-743d-4d09-ac40-3272e1f90bc5', '84645f68-06be-4009-8d3b-bc8402e7e9e4', '21f74596-fb6a-47cf-899d-a4910bf5e050', 'b9cbdeb5-baba-4ad9-b15d-0fdd5daf670a', 'a7c347da-631c-445c-b2e6-004a6894e069', 'a698aa11-3871-4c02-b0a5-985be0e71f6d'} {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.512509] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1516.537441] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.537673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.537673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.537880] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.537989] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.538125] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1516.538239] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.538315] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1516.656666] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.656924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.656924] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.657113] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.658220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.658458] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1516.658534] env[65119]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65119) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.658606] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1516.658672] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1516.658749] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/29 resources of Type:Security Group Rules [ 1516.658817] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGH for action security_group_rules [ 1516.658893] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGH for action security_group_rules [ 1516.658959] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGH for action security_group_rules [ 1516.659034] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGH for action security_group_rules [ 1516.659096] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGH for action security_group_rules [ 1516.659158] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGH for action security_group_rules [ 1516.659219] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGH for action security_group_rules [ 1516.659280] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGH for action security_group_rules [ 1516.659340] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGH for action security_group_rules [ 1516.659400] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGH for action security_group_rules [ 1516.659461] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGH for action security_group_rules [ 1516.659521] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGH for action security_group_rules [ 1516.659581] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGH for action security_group_rules [ 1516.659638] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGH for action security_group_rules [ 1516.659699] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGH for action security_group_rules [ 1516.659761] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGH for action security_group_rules [ 1516.659821] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGH for action security_group_rules [ 1516.659883] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGH for action security_group_rules [ 1516.659945] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1516.660013] env[65119]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGH for action security_group_rules [ 1516.660117] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.321482] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.321883] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1521.321883] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGH for action security_group_rules [ 1521.321883] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 with Priority: HIGH for action security_group_rules [ 1521.322094] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eeb8ed-53fe-4534-ba39-d93429300967 with Priority: HIGH for action security_group_rules [ 1521.322094] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec5d72a-5222-4ea2-bb61-5a248eace68e with Priority: HIGH for action security_group_rules [ 1521.322173] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 with Priority: HIGH for action security_group_rules [ 1521.322267] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 with Priority: HIGH for action security_group_rules [ 1521.322362] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 with Priority: HIGH for action security_group_rules [ 1521.322476] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 with Priority: HIGH for action security_group_rules [ 1521.322594] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 with Priority: HIGH for action security_group_rules [ 1521.322655] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb24203d-c552-4146-a5ac-8b7d840c9508 with Priority: HIGH for action security_group_rules [ 1521.322722] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 with Priority: HIGH for action security_group_rules [ 1521.322809] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed152bbd-2522-4d15-9d17-a181bc283606 with Priority: HIGH for action security_group_rules [ 1521.322917] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 with Priority: HIGH for action security_group_rules [ 1521.322979] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 with Priority: HIGH for action security_group_rules [ 1521.323078] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a with Priority: HIGH for action security_group_rules [ 1521.323167] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568eca14-d302-4960-af0c-9198176e727f with Priority: HIGH for action security_group_rules [ 1521.323255] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a096698e-b6ff-45f7-a422-2ae93392dd6a with Priority: HIGH for action security_group_rules [ 1521.323342] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 with Priority: HIGH for action security_group_rules [ 1521.323429] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a91696-7519-44b6-b10f-fc41ed3e295d with Priority: HIGH for action security_group_rules [ 1521.323515] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78855541-03b8-4d32-871e-c374cb44f414 with Priority: HIGH for action security_group_rules [ 1521.324057] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.324205] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.324272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.324478] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.324560] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.325761] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52318c6e-1af4-41b6-9118-fc6c36218f72 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.325875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.325875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.326055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.326135] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52318c6e-1af4-41b6-9118-fc6c36218f72',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.327231] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09eeb8ed-53fe-4534-ba39-d93429300967 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.327388] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.327460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.327971] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.327971] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09eeb8ed-53fe-4534-ba39-d93429300967',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.328716] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cec5d72a-5222-4ea2-bb61-5a248eace68e taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.328833] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.328966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.329209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.329312] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cec5d72a-5222-4ea2-bb61-5a248eace68e',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.330483] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77b26c46-fbab-436a-bd4d-c5014107aa41 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.330483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.330483] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.330726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.330726] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77b26c46-fbab-436a-bd4d-c5014107aa41',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.331491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.331611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.331611] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.331758] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.331836] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2d1c57-a6bd-4f0c-9911-e018a46e3355',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.332733] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d97212-9ce9-44c7-aea3-cb927043ab34 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.332733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.333220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.333220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.333220] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d97212-9ce9-44c7-aea3-cb927043ab34',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.333777] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.334210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.334210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.334210] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.334210] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7705f38-2e46-4cc6-a745-b9fed998f2e9',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.335284] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.335284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.335284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.335284] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.336039] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb75ad9c-4e20-475c-9f48-9dc0b70cd915',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.337044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb24203d-c552-4146-a5ac-8b7d840c9508 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.337044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.337044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.337044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.337044] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb24203d-c552-4146-a5ac-8b7d840c9508',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.337540] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.337629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.337751] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.337934] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.338029] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a32e7cc-5871-4cac-93b4-13eb1e04d001',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.338882] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed152bbd-2522-4d15-9d17-a181bc283606 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.339038] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.339108] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.339322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.339409] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed152bbd-2522-4d15-9d17-a181bc283606',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.340738] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.340884] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.340982] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.341190] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.341338] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce292fb-ef03-4deb-8b4d-98b3ea31c815',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.342220] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.342361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.342420] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.342610] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.342688] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a40b8a7-01bb-4eb9-8b40-fe7596c9d197',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.343441] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.343587] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.343693] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.343911] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.344050] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511a8f2f-3767-4d34-9d44-c9a6cd510c1a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.346602] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568eca14-d302-4960-af0c-9198176e727f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.346767] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.346878] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.347139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.347257] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568eca14-d302-4960-af0c-9198176e727f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.348253] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a096698e-b6ff-45f7-a422-2ae93392dd6a taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.348366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.348453] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.348629] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.348804] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a096698e-b6ff-45f7-a422-2ae93392dd6a',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.349543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1befdc0c-fdef-47d8-a265-90eb419b7428 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.349649] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.349729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.349879] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.349950] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1befdc0c-fdef-47d8-a265-90eb419b7428',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.350649] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13a91696-7519-44b6-b10f-fc41ed3e295d taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.350757] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.350825] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.350970] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.351054] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13a91696-7519-44b6-b10f-fc41ed3e295d',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.351825] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78855541-03b8-4d32-871e-c374cb44f414 taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.351966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.352046] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.352145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.352212] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78855541-03b8-4d32-871e-c374cb44f414',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.398054] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.398301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.398301] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.398425] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.410951] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.411145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.411999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.412141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.412814] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.412922] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.413669] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.413787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.420145] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.420263] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cec5d72a-5222-4ea2-bb61-5a248eace68e is going to be deleted. [ 1521.421424] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.421632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.447361] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.447361] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09eeb8ed-53fe-4534-ba39-d93429300967 is going to be deleted. [ 1521.448135] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.448349] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.475327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.475506] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52318c6e-1af4-41b6-9118-fc6c36218f72 is going to be deleted. [ 1521.476895] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.477128] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.496404] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.496404] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.516071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.516071] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2d1c57-a6bd-4f0c-9911-e018a46e3355 is going to be deleted. [ 1521.516363] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.516578] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.536824] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.537015] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.547699] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.547894] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77b26c46-fbab-436a-bd4d-c5014107aa41 is going to be deleted. [ 1521.548848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.549075] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.549180] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.549303] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cec5d72a-5222-4ea2-bb61-5a248eace68e" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.549455] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.549616] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.549694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.549803] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09eeb8ed-53fe-4534-ba39-d93429300967" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.586437] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.586673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.586673] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.586901] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.586996] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.587139] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52318c6e-1af4-41b6-9118-fc6c36218f72" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.642296] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.642531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.642531] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.642762] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.642839] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.642985] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77b26c46-fbab-436a-bd4d-c5014107aa41" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.643968] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.644141] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.644246] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.644485] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.644609] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.644740] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2d1c57-a6bd-4f0c-9911-e018a46e3355" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.855494] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.855764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.855764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.856041] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.856268] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.856386] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.856440] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.856615] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.856692] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.856802] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.856959] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.917276] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.917552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.917552] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.917725] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.919622] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.919732] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.921135] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.921241] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.922013] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.922112] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.922721] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.922816] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.923612] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.923727] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.924761] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.924861] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.925600] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.925695] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.926580] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.926677] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.927385] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.927481] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.928400] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.928509] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.929151] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1521.929620] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.929750] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.930359] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1521.930787] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.930888] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.939615] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1521.940262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.940370] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.951892] env[65119]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1521.952523] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.952663] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d97212-9ce9-44c7-aea3-cb927043ab34 is going to be deleted. [ 1521.954033] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.954258] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.981774] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.981990] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1befdc0c-fdef-47d8-a265-90eb419b7428 is going to be deleted. [ 1521.982842] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.983065] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.008502] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.008689] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb24203d-c552-4146-a5ac-8b7d840c9508 is going to be deleted. [ 1522.009580] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.009807] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.022262] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.022476] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.042536] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.042764] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce292fb-ef03-4deb-8b4d-98b3ea31c815 is going to be deleted. [ 1522.043754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.043966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.070365] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.070584] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.088279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.088456] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568eca14-d302-4960-af0c-9198176e727f is going to be deleted. [ 1522.089343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.089559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.133821] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.134074] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.146510] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.146686] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511a8f2f-3767-4d34-9d44-c9a6cd510c1a is going to be deleted. [ 1522.147634] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.147822] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.149571] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.149726] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.213652] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.213907] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a096698e-b6ff-45f7-a422-2ae93392dd6a is going to be deleted. [ 1522.214733] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.214953] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.245343] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.245564] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.265491] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.265718] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.283525] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.283706] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb75ad9c-4e20-475c-9f48-9dc0b70cd915 is going to be deleted. [ 1522.284669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.284887] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.364103] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.364581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.364581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.364581] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.364750] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.364862] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.364919] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.365095] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.365181] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.365272] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.365442] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.365573] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.365648] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.365859] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.366044] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.366155] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.366220] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.366368] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.366446] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.366529] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.366619] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.369543] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.369966] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.403764] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.403942] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed152bbd-2522-4d15-9d17-a181bc283606 is going to be deleted. [ 1522.404829] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.405062] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.452052] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.452277] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.462055] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.462241] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13a91696-7519-44b6-b10f-fc41ed3e295d is going to be deleted. [ 1522.463132] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.463357] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.503245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.503433] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a32e7cc-5871-4cac-93b4-13eb1e04d001 is going to be deleted. [ 1522.504385] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.504607] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.569274] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.569425] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78855541-03b8-4d32-871e-c374cb44f414 is going to be deleted. [ 1522.570383] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.570627] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.605999] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.605999] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.640093] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.640093] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a40b8a7-01bb-4eb9-8b40-fe7596c9d197 is going to be deleted. [ 1522.640686] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.640903] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.698613] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.698848] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.706037] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.706037] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.726071] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.726071] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7705f38-2e46-4cc6-a745-b9fed998f2e9 is going to be deleted. [ 1522.726444] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.726666] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.726784] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.726973] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d97212-9ce9-44c7-aea3-cb927043ab34" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.727160] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.727327] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.727409] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.727526] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1befdc0c-fdef-47d8-a265-90eb419b7428" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.728083] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.728279] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.728436] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.728537] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb24203d-c552-4146-a5ac-8b7d840c9508" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.728681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.728834] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.728913] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.729044] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce292fb-ef03-4deb-8b4d-98b3ea31c815" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.729174] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.729316] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.729390] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.729506] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568eca14-d302-4960-af0c-9198176e727f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.729632] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.729772] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.729846] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.729952] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511a8f2f-3767-4d34-9d44-c9a6cd510c1a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.730091] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.730234] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.730307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.730414] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a096698e-b6ff-45f7-a422-2ae93392dd6a" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.730539] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.730681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.730754] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.730864] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb75ad9c-4e20-475c-9f48-9dc0b70cd915" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.730984] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.731137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.731209] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.731322] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed152bbd-2522-4d15-9d17-a181bc283606" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.731541] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.731593] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.731665] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.731756] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a32e7cc-5871-4cac-93b4-13eb1e04d001" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.731877] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.732018] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.732109] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.732226] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13a91696-7519-44b6-b10f-fc41ed3e295d" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.816648] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.816894] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.816977] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.817157] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.817245] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.817366] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78855541-03b8-4d32-871e-c374cb44f414" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.868906] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0aa7f6-2744-4386-a933-45a3c921090f: rpc.has_security_group_logging(os_id): False [ 1522.879693] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.879830] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.879875] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.880097] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.880189] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.880306] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a40b8a7-01bb-4eb9-8b40-fe7596c9d197" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.945278] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.945511] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.945595] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.945781] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.945874] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.945995] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7705f38-2e46-4cc6-a745-b9fed998f2e9" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.947118] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.947261] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.947307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.947498] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.000694] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.000889] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.001030] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.001102] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.001305] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.001387] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.001574] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.001669] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.001730] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.001881] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.001945] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.002136] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.002228] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.002302] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.002460] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.002535] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.002623] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1523.164895] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.165073] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.165185] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.165410] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.165559] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.192405] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1525.213964] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1525.214391] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.324445] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.324771] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.815256] env[65119]: INFO networking_nsxv3.common.synchronization [req-da7de4c6-3a8b-4744-8768-373586510222 req-1c8f670d-4aaa-45b2-9c6b-f8c65abb3248 tempest-ServersNegativeTestJSON-429590187 tempest-ServersNegativeTestJSON-429590187-project-member] Enqueued Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1528.815661] env[65119]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0aa7f6-2744-4386-a933-45a3c921090f with Priority: HIGHEST for action security_group_members [ 1528.815996] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0aa7f6-2744-4386-a933-45a3c921090f taken with stack trace [, , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.816271] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.816343] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.816538] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.816696] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.816811] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.816905] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.817085] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.817159] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.817245] env[65119]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0aa7f6-2744-4386-a933-45a3c921090f',) {} {{(pid=65119) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.322264] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.322533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.322533] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.322696] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.322787] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.323025] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.323137] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.323191] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.323307] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.323378] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.323466] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f is going to be updated. [ 1529.361557] env[65119]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65119) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.361729] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.361778] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.361978] env[65119]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.362140] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.370919] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: IN_PROGRESS for 2s [ 1531.389278] env[65119]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0aa7f6-2744-4386-a933-45a3c921090f in Status: SUCCESS [ 1531.389681] env[65119]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0aa7f6-2744-4386-a933-45a3c921090f deletion is rescheduled due to dependency. [ 1531.389681] env[65119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0aa7f6-2744-4386-a933-45a3c921090f" {{(pid=65119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.816995] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.817357] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.817880] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.818245] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.818975] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.819398] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.820203] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.822421] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.821779] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.822269] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.822903] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.823337] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.823576] env[65119]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.824039] env[65119]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0